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ABSTRACT 

When  subjects  have  complete  knowledge  of  the 
probability  distribution  governing  a  set  of  outcomes,  their 
subjective  probability  estimates  have  been  found  to  be 
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desirability.  With  the  use  of  linguistic  probability 
expressions,  this  study  attempted  to  extend  this  finding  to 
situations  in  which  subjects  have  only  vague  knowledge  or 
no  knowledge  of  the  probability  distribution  relevant  to  a 
set  of  outcomes.  It  was  found  that  subjects'  comparisons 
were  biased,  in  varying  degrees  depending  on  the  particular 
phrase  under  consideration,  towards  the  relatively  more 
desirable  outcome.  This  finding  indicates  that  a  complete 
model  of  Judgment  under  uncertainty  must  include  a  factor 
for  context  effects  such  as  outcome  desirability. 
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Introduction 


Earlier  theories  of  judgment  under  uncertainty  (e.g. 
Knight,  1921;  Savage,  195*0  have  assumed  that  the  decision- 
maker  is  a  rational  being,  conforming  to  basic  axioms  of 
probability.  This  study  examines  an  aspect  of  irrational 
decision-making;  namely,  the  ways  in  which  judgments  about 
uncertain  outcomes  are  affected  by  the  Independent 
desirability  of  those  outcomes.  The  Independent 
desirability  of  an  outcome  refers  to  the  value  of  the 
outcome  Itself,  independently  of  one’s  prediction.  This 
study  extends  the  finding  (Harks,  1951;  Irwin  &  Snodgrass, 
1966;  Irwin  &  Metzger,  1966;  Slovlc,  1966)  that  Independent 
outcome  desirability  affects  subjective  probability,  in 
direct  opposition  to  a  fundamental  axiom  of  rationality. 

The  work  of  Irwin,  et  al.,  on  Independent  outcome 
desirability  was  motivated  in  part  from  Irwin's  Interest  in 
the  types  of  factora  affecting  people's  expectations  of 
outcomes.  He  held  that  there  were  cognitive  factors,  which 
would  lead  to  realistic  expectations,  as  well  as  affective 
factors,  which  would  lead  to  unrealistic  expectations 
(Irwin,  19*>4).  Underlying  this  research  may  have  been 
Irwin's  intent  to  develop  a  more  complete  model  of  judgment 
than  the  subjectively  expected  utility  (SEU)  model.  The 
results  found  by  Irwin,  et  al.  indicate  that,  at  the  least. 


it  nay  be  necessary  to  control  for  independent  outcome 
desirability  in  SEU  models. 

Uncertainty  is  a  broad  concept,  including  all  states 
of  knowledge  other  than  perfect  about  the  occurrence  of 
events.  Is  an  attempt  to  segment  the  construct  of 
uncertainty,  Ellsberg  (1961)  described  three  states  of 
knowledge  regarding  the  probabilities  of  future  events.  He 
labeled  these  conditions  "risk",  "ambiguity",  and  "complete 
Ignorance",  representing  precise  knowledge  of 
probabilities,  vague  or  imprecise  knowledge  of 
probabilities,  and  absolutely  no  information  about 
probabilities,  respectively.  If  the  probabilities  are 
known  to  be  either  exactly  0  or  exactly  1,  however,  this 
corresponds  to  a  situation  of  certainty. 

As  will  be  documented  below,  it  is  already  known  that 
under  conditions  of  risk,  subjective  probabilities  are 
positively  related  to  Independent  outcome  desirabl 1 ity. 
However,  people  commonly  make  decisions  based  on 
information  that  is  ambiguous  or  imprecise,  or  even  on  the 
basis  of  no  information  at  all,  which  corresponds  to 
Ellsberg's  states  of  ambiguity  and  complete  Ignorance, 
respectively.  This  study  examines  the  effect  of 
independent  outcome  desirability  on  judgments  under 
ambiguity  and  complete  ignorance. 

There  are  at  least  two  major  ways  to  express 
uncertainty  in  an  ambiguous,  vague,  or  imprecise  manner. 

One  way  is  to  use  a  range  of  numerical  probability  values 
to  describe  the  probability  of  an  outcome,  while  the  other 
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is  to  use  verbal  expressions  of  uncertainty.  The  latter 
was  used  in  the  present  study,  in  order  to  further 
investigate  the  factors  that  affect  the  meanings  of 
probability  terms. 


Literature  Review 

Rationality,  Uncertainty,  and  the  El lsberg  Paradox 

For  people  to  be  rational  decision-makers,  they  oust 
confora  to  certain  basic  axioms  of  rationality.  One  of 
these  axioms  holds  that  choices  are  completely  ordered 
according  to  the  Judged  values  of  the  consequences  of  those 
choices.  Another  Important  axiom  is  the  sur#. thing 
principle  (Savage,  1954),  according  to  which,  people's 
ordering  of  alternative  choices  should  be  unaffected  by 
adding  a  constant  to  the  value  of  the  consequences  of  each 
choice.  A  third  principle  requires  people  to  be  free  of 
"wishful  thinking"  (Radnor,  1972)*  That  is,  one's  ranking 
of  probabl 1 ities  of  events  should  be  independent  of  the 
consequences  of  those  events. 

These  axioms  of  rationality  are  not  predictive  of 
actual  behavior,  however.  Ellsberg  (1961)  has  shown  that 
certain  commonly  obtained  choice  patterns  are  in  violation 
of  the  first  two  of  these  axioms.  The  present  study  is 
designed  to  examine  violations  of  all  three  of  these 
axioms,  but  the  primary  hypothesis  of  this  experiment  is 
that  decision-makers  will  consistently  violate  the  third 
principle  listed  above. 
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According  to  Ellsberg,  a  condition  of  riak  exists  when 
a  decision-maker  knows  with  certainty  the  probability 
distribution  over  a  set  of  outcomes.  A  state  of  comp  1 ete 
Ignorance  exists  when  the  decision-maker  has  absolutely  no 
information  about  the  probability  distribution  over 
outcomes.  Ellsberg  showed  that  a  person's  ordering  of 
gambles  depends  upon  whether  that  person  is  operating  under 
a  condition  of  risk  or  a  condition  of  ignorance. 

Between  the  extremes  of  risk  and  complete  ignorance 
lies  the  state  of  ambiguity,  in  which  the  decision-maker 
can  rule  out  at  least  one  probability  distribution. 

However,  under  ambiguity,  more  than  one  probability 
distribution  remains  under  consideration,  and  the  decision¬ 
maker  does  not  have  enough  information  to  determine  which 
probability  distribution  is  operative.  One  of  the  purposes 
of  this  study  is  to  extend  Ellsberg's  results  to  situations 
of  ambiguity  represented  by  probability  phrases  such  as 
likely,  doubtful,  good  chance,  and  so  forth. 

The  Importance  of  distinguishing  the  three  types  of 
uncertainty  becomes  apparent  in  light  of  the  Ellsberg 
paradox.  This  paradox  can  be  described  by  considering  a 
situation  in  which  there  exist  two  urns  containing  100  red 
and  black  balls  each.  The  proportion  of  red  and  black 
balls  in  Urn  1  is  completely  unknown,  whereas.  Urn  II 
contains  exactly  50  red  balls  and  50  black  balls.  Thus, 

Urn  I  corresponds  to  a  state  of  nearly  complete  Ignorance, 
while  Urn  II  corresponds  to  a  state  of  risk.  Let  RedI, 
BlackI,  Redll,  and  Blackll  represent  the  event  of  drawing  a 


red  ball  frog  Urn  I,  a  black  ball  from  Urn  I,  a  red  ball 
froa  Urn  II,  and  a  black  ball  froa  Urn  IX,  respectively. 
Then,  the  parados  lies  In  typical  answers  to  the  following 
four  questions: 

1.  Which  do  you  prefer  to  bet  on.  Red!  or  BlackX,  or 
are  you  indifferent? 

2.  Which  do  you  prefer  to  bet  on,  RedXI  or  BlackXI, 

■ 

or  are  you  indifferent? 

3.  Which  do  you  prefer  to  bet  on,  RedI  or  Redll,  or 
are  you  indifferent? 

4.  Which  do  you  prefer  to  bet  on,  BlackX  or  Blackll, 
or  are  you  indifferent? 

Most  people  answer  the  first  two  questions  with 
indifference  responses,  implying  that  they  feel  that 
Pr(Redl)  *  Pr(Blackl)  and  Pr(Redll)  *  Pr(Blackll).  Since 
Pr(Redl)  ♦  Pr(Blackl)  a  1  and  Pr(Redll)  ♦  Pr(Blackll)  *  1, 
these  Indifference  responses  further  laplv  that  Pr(Redl)  = 
Pr(RedlX)  a  Pr(Blaokl)  *  Pr(Blackll)  a  0.50.  A  paradox 
occurs  because  aost  people  will  then  respond  to  questions 
(3)  and  (4)  with  RedIX  and  BlackXX,  respectively.  The 
response  of  RedXX  in  question  (3)  implies  that  Pr(Redll)  > 
Pr(RedX),  from  which  it  logically  follows  that  Pr(BlackXX) 
<  Pr(BlackX),  due  to  the  fact  that  Pr(RedX)  ♦  Pr(BlackX)  a 
1.  However,  this  is  contradicted  by  the  choice  of  Blackll 
in  question  (4),  which  implies  that  Pr(BlackXX)  > 
Pr(Blaekl).  This  pattern  of  responses  violates  the  first 
two  axloas  of  rationality  described  above. 


6 

From  the  above  discussion,  it  appears  that  people 
prefer  to  bet  on  events  with  known  rather  than  unknown 
probabilities.  Such  betting  preferences  may  depend  on  how 
probabilities  of  events  are  Judged  under  ambiguity,  but 
they  may  also  depend  on  an  aversion  to  gambling  under 
conditions  of  Ignorance.  For  research  purposes.  It  Is 
useful  to  employ  a  technique  that  distinguishes  Judgments 
under  uncertainty  from  avoidance  of  ambiguity  in  gambling 
scenarios.  In  the  present  study,  subjects  responded  by 
Indicating  their  degree  of  confidence  in  their  judgment 
that  one  event  is  more  likely  to  occur  than  is  another 
event.  Other  studies  have  examined  aspects  of  the  Ellsberg 
paradox  (Fellner,  1961;  Becker  &  Brownson,  1964;  Yates  & 

Zukowski,  1976;  Elnhorn  &  Hogarth,  1985;  Einhorn  t  Hogarth, 

In  press).  In  these  studies,  however,  the  values  of 
outcomes  were  dependent  upon  subjects'  responses,  as 
opposed  to  the  present  study's  use  of  Independent  outcome 
values . 

Ambiguity  and  Probabl 1 lty  Terms 

One  can  describe  the  uncertainty  of  an  outcome  In  an 
ambiguous  fashion  by  defining  a  range  of  numerical 
probability  values  relating  to  the  event  In  question.  An 
alternative  approach  toward  ambiguity  can  be  found  in  the 
use  of  probability  words  or  phrases.  Probability  terms, 
such  as  likely,  doubtful ,  good  chance,  etc.,  are  generally 
used  by  people  to  describe  uncertain  events. 

There  are  many  possible  reasons  that  people  frequently 
prefer  to  use  non-numerlcal  estimates  of  probabilities. 


One  reason  suggested  by  Vallsten,  Budescu,  Rapoport,  Zwlck, 
and  Forsyth  (In  press)  is  that  people  prefer  to  express 
imprecise  opinions  in  imprecise  teres,  such  as  probability 
phrases.  Secondly,  Zimmer  (1983)  held  that  nest  people 
deal  more  effectively  with  verbal  than  with  numerical 
expressions  of  uncertainty.  Note  that  children  learn  how 
to  talk  long  before  they  learn  how  to  perform  arithmetic 
and  calculate  percentages.  Additionally,  Zimmer  noted  that 
a  mathematical  treatment  of  probability  was  net  conceived 
until  1660,  while  verbal  expressions  of  uncertainty  existed 
in  most  languages  for  a  long  time  before  that.  Another 
reason  for  the  common  use  of  verbal  expressions  of 
uncertainty  may  stem  from  people's  desire  to  use  a  verbal 
rather  than  numerical  style  of  written  and  spoken 
communication.  There  are  many  real-world  events  for  which 
a  numerical  probability  estimate  would  seem  less 
appropriate  than  a  verbal  probability  expression.  For 
example,  it  seems  much  more  sensible  to  say  "it  was 
possible  but  not  likely",  rather  than  "there  was  a  10-151 
chance"  with  reference  to  the  event  that  Shakespeare  was 
thinking  of  Ann  Hathaway  when  he  wrote  his  twelfth  sonnet. 

Beyth-Marom  (1982)  suggested  other  reasons  for  the  use 
of  non-numerical  probability  estimates.  First,  they 
prevent  one's  estimate  from  being  Judged.  Secondly,  they 
allow  one  to  avoid  making  explicit  derivations  to  defend 
the  estimate.  Thirdly,  many  people  believe  that  a 
probability  phrase  is  no  more  ambiguous  than  is  a  range  ef 


numerical  probability  values.  Baoausa  most  peopla  use 
probability  phrases  to  express  degrees  of  uncertainty.  It 
Is  important  to  study  the  factors  that  affect  the  aeanlngs 
of  these  probability  teras. 

Measurement  of  Vagueness 

A  problea  with  studying  aabiguity  in  verbal  rather 
than  numerical  expressions  is  that  the  measurement  of 
ambiguity  is  not  as  straightf orward.  It  Involves  the 
formulation  of  a  reasonable  means  of  transforming  verbal 
expressions  of  uncertainty  into  measurable  quantities. 
Although  it  will  not  be  necessary  to  actually  aeasure  the 
meanings  of  terms  used  in  this  study,  it  is  still 
appropriate  to  discuss  measurement  techniques  for  two 
reasons.  First,  prior  measurement  of  each  of  the  terms 
used  in  this  study  (except  for  the  term,  unspecified)  was 
required  to  determine  important  parts  of  the  experimental 
design.  Secondly,  the  present  research  may  provide 
knowledge  about  factors  that  should  be  considered  when 
measuring  the  meanings  of  vague  teras. 

One  approach  toward  the  measurement  of  the  meanings  of 
probability  words  Involves  gathering  numerical  probability 
estlaates  for  probability  phrases  froa  a  large  number  of 
subjects.  Froa  these  data,  information  about  the  central 
probability  value  and  the  variability  in  probability  values 
for  each  tera  can  be  determined.  This  technique  has  been 
used  often  in  previous  research  on  the  meanings  of 
probability  or  frequency  teras  (Slapson,  1 9 *» 4 ,  1963;  Stone 
A  Johnson,  1959,  Lichstensteln  &  Newaan,  1967;  Hakel,  1968; 


Beyth-Maroa,  1982).  All  of  these  studies  found 
considerable  variability  over  subjects  in  the  assignment  of 
nuabers  to  probability  phrases.  However*  the  probability 
phrases  did  have  fairly  consistent  numerical  meanings  to 
Individual  subjects  over  time  (Beyth-Harom,  1982).  A 
problea  with  this  technique  Is  that  It  does  not  address  the 
issue  of  whether  the  probability  phrases*  themselves,  have 
vague  meanings  to  individuals*  or  whether  people  merely 
differ  in  their  interpretation  of  probability  values 
(Budescu  &  Wallsten,  1985). 

In  other  research*  it  has  been  suggested  that  the 
meaning  of  a  probability  tera  can  be  represented  by  a 
membership  function  on  the  £0,1]  interval  (Zadeh*  1978; 
Watson,  Weiss  A  Donnell*  1979).  A  membership  function 
Indicates  the  degree  to  which  an  event*  object*  or  value 
"fits”  Into  a  vague  description  or  category.  In  the  case 
of  probability  terms*  a  membership  function  would  show  how 
well  each  probability  value  Is  described  by  a  particular 
term.  These  membership  functions  can  take  on  any  shape 
whatsoever*  but  continuous  single-peaked  or  monotonic 
functions  are  the  easiest  to  analyze  and  make  the  most 
sense  conceptually. 

The  specific  numerical  probability  value  (or  values) 
that  are  best  described  by  a  particular  phrase  would  take 
on  the  aaximua  value  of  the  membership  function  (usually 
one).  Those  probability  values  that  are  not  at  all 
described  by  a  probability  phrase  would  take  on  the  minimum 


value  of  the  function  (usually  zero).  Other  probabilities 
with  Intermediate  degrees  of  membership  In  the  concept 
represented  by  the  phrase  would  generally  take  oa 
Intermediate  values  between  zero  and  one  In  this  function. 

Wall sten,  et  al,  (In  press)  utilized  a  modified  pair- 
comparison  procedure  to  measure  the  vagueness  of 
probability  phrases.  In  this  procedure*  subjects  judged 
pairs  of  probability  values  with  respect  to  how  much  better 
one  rather  than  the  other  was  described  by  each  of  various 
probability  terms.  If  the  properties  of  the  resulting  data 
satisfy  the  axioms  of  an  additive  difference  structure 
(Krantz.  Suppes*  Luce*  4  Tversky*  1971)*  then  It  is 
legitimate  to  use  certain  scaling  procedures  to  derive  the 
membership  function  for  each  probability  term.  These 
scaling  techniques  allow  one  to  make  predictions  about 
subjects'  responses  in  the  palr-compar Ison  task.  It  was 
found  that  observed  and  predicted  responses  were  correlated 
In  the  range  of  0.75  to  0.77.  Independent  judgments  In  a 
related  modified  pair-comparl son  task  were  also  found  to  be 
predicted  by  the  responses  on  the  first  task.  Further* 
responses  were  found  to  be  consistent  for  subjects  over 

time  (average  correlation  of  0.88  between  sessions).  The 

! 

shapes  and  locations  of  the  membership  functions  gathered 
In  that  study  revealed  large  Individual  differences* 
however . 

Factors  Affecting  the  Meanings  of  Probabl 1 lty  Terms 

Environmental  factors  may  play  a  large  role  In 
people's  Inter pr etations  of  probability  phrases.  The 
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r esearoh  problem  could  be  expressed  in  terns  of  determining 
the  individual  difference  and  context  factors  that  affect 
the  judged  meanings  of  probability  terms,  regardless  of  the 
way  in  which  the  meanings  are  derived.  Factors  that  might 
affect  the  meaning  of  a  probability  phrase  to  an  individual 
Include,  among  other  things:  (1)  the  reliability  of  the 
information  source(s);  (2)  the  number  of  sources  of 
information;  (3)  the  number  of  words ‘in  one's  vocabulary  of 
probability  phrases;  (4)  general  semantio  context;  (5)  the 
importance  of  the  event  being  analyzed;  (6)  the  base  rata 
of  occurrence  of  the  event.  The  effects  of  some  of  these 
context  factors  on  probability  or  frequency  phrases  have 
been  the  focus  of  previous  research  (Pepper  &  Prytulak, 

1974;  Beyth-Marom,  1982;  Wallsten,  Fillenbaum  &  Cox, 

1986). 

This  study  is  primarily  concerned  with  a  specific 
context  effect  —  the  desirability  of  the  outcomes  of  the 
event  being  analyzed  by  the  decision-maker.  Desirability 
is  somewhat  related  to  the  importance  of  the  event, 
although  outcomes  can  have  differing  desirabilities  while 
Importance  is  held  constant.  It  seems  reasonable  to  assume 
that  a  continuum  of  desirability  exists  at  each  level  of 
importance  of  events.  For  example,  both  flunking  a  test 
and  nuclear  war  could  be  rated  by  a  subject  as  highly 
undesirable,  but  certainly  the  latter  event  is  more 
important.  Importance  was  held  constant  in  this  study, 
while  desirability  was  manipulated  by  the  winning  or  losing 


of  points  on  each  trial. 

Outcome  Desirability 

The  effects  of  outcome  desirability  on  subjective 
probabilities  under  conditions  of  risk  have  been  studied  in 
depth  (Marks,  1951;  Scheibe,  1964;  Morlock  4  Hertz,  1964; 
Pruitt  4  Hoge,  1965;  Irwin  4  Snodgrass,  1966;  Irwin  4 
Metzger,  1966;  Slovic,  1966;  Irwin  4  Graee,  1968).  In 
these  studies,  subjects'  choices  or  estimates  of  the 
likelihoods  of  events  were  positively  related  to  the 
Independent  values  of  the  events.  The  Independent  outcome 
values  (IOs)  are  to  be  distinguished  from  the  dependent 
outcome  values  (DOs),  which  depend  on  the  accuracy  of  the 
person's  prediction. 

Irwin  4  Snodgrass  (1966)  gauged  subjective 
probabilities  by  means  of  a  betting  procedure,  in  which  the 
frequency  of  subjects'  positive  bets  was  the  dependent 
variable.  Subjects  made  bets  within  a  prescribed  range  on 
whether  or  not  a  marked  card  would  be  drawn  from  a  deck 
with  a  known  number  of  marked  and  unmarked  cards.  In 
addition  to  winning  or  losing  the  bet,  subjects  won  or  lost 
money  if  a  marked  card  was  drawn,  regardless  of  their 
prediction.  The  bet  thus  determined  the  DO  and  the 
additional  winnings  or  losses  attributable  to  the  drawing 
of  a  marked  card  became  the  10.  It  was  found  that  positive 
IOs  led  to  a  higher  frequency  of  positive  bets  than  did 
negative  IOs.  Further,  this  effect  was  strongest  for 
objective  probabilities  (proportions  of  marked  cards) 
closest  to  0.50.  In  a  related  study,  Irwin  and  Metzger 
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(1966)  found  that  the  positive  relationship  between  10  and 
estlaated  likelihood  was  maintained  even  when  10  was 
probabilistic.  In  this  study,  the  10s  had  well-defined 
positive  or  negative  expected  values,  but  on  any  given 
trial  subjects  did  not  know  with  certainty  whether  they 
would  win  or  lose  money  for  drawing  a  marked  card. 

A  slightly  different  paradigm  was  utilized  by  Slovlc 
(1966)  to  test  the  effect  of  deslrabl'l it y  on  Judged 
likelihood.  In  his  study,  subjects  gave  direct  numerical 
estimates  of  subjective  probabilities  under  conditions  of 
varying  10.  Again,  it  was  found  that  estimated  likelihoods 
of  events  were  positively  related  to  desirabilities  of  IOs. 

Slovlc  termed  this  effect  "partial  optimism"  because  it 
related  only  to  the  sign  of  the  10,  not  to  its  magnitude. 

Also,  Irwin  A  Graee  (1968)  were  unable  to  find  a  consistent 
significant  relationship  between  10  and  choice 
probabilities  for  paired  events  when  the  IOs  for  the  two 
events  under  consideration  had  the  same  sign,  but  different 
magnitudes.  There  was,  however,  a  significant  effect  of  10 
magnitude  at  some  levels  of  objective  probability. 

Crandall,  Solomon,  A  Kellaway  (1955)  found  a  significant 
overall  Interaction  between  10  and  choice  probabl 1 1  ties 
when  both  IOs  had  the  same  sign.  When  this  effect  was 
analyzed  at  each  level  of  objective  probability,  however, 
it  was  not  significant. 

In  all  cases  described  above,  the  events  for  which 
subjects  estimated  probabilities  were  precisely  defined. 
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That  ls(  tha  information  on  which  subjects  based  their 
subjective  probabi lities  was  either  full  knowledge  of  the 
probability  distribution  of  avents  or  sample  information 
relating  to  a  specific  probability  distribution  of  events. 
Thus,  subjects  were  responding  under  conditions  of  risk,  as 
described  by  Ellsberg.  If  subjects  had  had  only  vague  or 
ambiguous  information  on  the  distribution  of  outcomes,  or 
perhaps  no  information  at  all  (creating  an  Ellsberg  paradox 
situation),  thel*  subjective  probabilities  might  have  been 
affected  differently  by  10  desirability. 

Purpose  and  Hypotheses 

The  main  purpose  of  this  experiment  was  to  examine  the 
effect  of  Independent  outcome  desirability  on  judgments 
made  under  conditions  of  ambiguity  and  Ignorance,  as 
represented  by  verbal  expressions.  A  secondary  goal  of  the 
experiment  was  to  determine  If  different  probability 
phrases  show  different  effects  due  to  10  desirability. 

On  every  trial,  subjects  were  given  information  about 
the  likelihood  of  occurrence  of  two  outcomes.  Each  outcome 
had  a  certain  10  associated  with  It.  For  one  outcome, 
subjects  were  given  objective  probability  Information,  and 
for  the  other  outcome,  they  were  provided  either  ambiguous 
Information  (a  probability  term)  or  no  Information  at  all. 
The  latter  case  represented  a  condition  similar  to  the 
Ellsberg  paradox.  Subjects  then  Indicated  their  degree  of 
confidence  that  one  outcome  was  more  likely  to  occur  than 
the  other  outcome.  It  was  hypothesized  that  subjects' 


responses  in  this  experiment  would  be  positively  biased 
toward  the  outcome  with  the  relatively  favorable 
desirability  factor.  Further,  this  bias  should  be 
strongest  in  cases  where  an  objective  probability  of  0.50 
was  matched  with  the  probability  terms,  tossup  and 
unspecified  (the  Ellsberg  paradox  condition),  according  to 
the  results  of  Irwin  &  Snodgrass  (1966).  Thus,  when  the 
objective  probability  of  0.50  has  associated  with  it  a 
negative  desirability  and  the  probability  phrase. 
unspecified,  has  associated  with  it  a  positive 
desirability,  the  verbal  expression  should  be  interpreted 
with  a  subjective  value  greater  than  that  accorded  the 
objective  probability.  This  would  be  a  contradiction  of 
El  1 sberg's  contention  that  people's  intuition  usually  leads 
them  to  accord  a  higher  subjective  value  to  an  objective 
probability  of  0.50  (risk)  than  to  an  event  for  which 
people  were  completely  ignorant  of  probabi 1 ities.  This 
bias  due  to  desirability  could  be  construed  as:  (1)  a 
change  in  the  Judged  meaning  of  a  given  probability  phrase 
(perhaps  a  change  in  the  shape  or  location  of  the 
membership  function  for  that  phrase),  (2)  a  change  in  the 
subjective  value  accorded  the  objective  value  of  0.50,  (3) 
a  type  of  ambiguity  aversion,  or  (4)  some  combination  of 
the  above. 

In  this  experiment,  one  could  have  asked  subjects  to 
bet  on  either  the  risky  event  or  on  the  event  with  the 
vaguely  specified  probability,  while  manipulating  the 
desirability  factor.  The  drawback  to  that  design,  however. 


is  that  any  effeots  due  to  desirability  sight  be  confounded 
with  subjects'  desire  to  avoid  aoblgulty  in  a  gambling 
scenario.  The  present  design  controls  for  this  factor  by 
asking  subjects  to  give  their  best  judgaents  of  the 
relative  likelihoods  of  the  two  paired  events,  the 
consequences  of  which  are  Independent  of  their  judgaents. 

Method 

Subjects 

Twenty  graduate  students  recruited  with  notices 
distributed  in  the  social  science  departments,  the  Business 
School,  and  the  School  of  Journalism  at  the  University  of 
North  Carolina  at  Chapel  Hill  served  as  paid  subjects.  At 
the  end  of  the  experiment,  a  cash  bonus  of  $10  was  paid  to 
those  ten  people  whose  point  totals  were  the  highest. 
Procedure 

Subjects  performed  the  experiment  individually  while 
seated  in  a  small  cubicle.  Stimuli  were  presented  on  the 
color  monitor  of  an  IBM  PC.  and  responses  were  made  by 
means  of  a  joystick  connected  to  the  computer. 

The  computer  screen  was.  in  effect,  split  in  half  from 
top  to  bottom.  One  side  of  the  screen  showed  a  probability 
spinner  with  a  radial  portion  of  the  spinner  colored  white 
and  the  remainder  colored  red.  Subjects  were  Informed  that 
the  displayed  proportion  of  white  in  the  spinner 
represented  the  true  probability  of  that  spinner's  landing 
on  white. 
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On  the  other  side  of  the  screen,  subjects  received 
lnforaatlon  relating  to  the  likelihood  of  another  spinner's 
landing  en  white,  but  were  not  able  to  actually  view  this 
other  spinner.  Instead,  they  saw  one  of  six  phrases. 

There  were  five  probability  teras  (doubtful,  improbable, 
tossup,  likely,  or  good  chance)  which  were  each  followed  by 
the  phrase,  ”...  to  land  on  white.”  These  phrases 
described  the  likelihood  of  that  spinner's  landing  on 
white.  (Hereafter,  this  will  be  referred  to  as  the 
invisible  spinner.)  In  one  condition,  subjects  saw  the 
phrase,  "Unspecified  to  land  on  white,"  which  they 
understood  to  mean  that  absolutely  no  lnforaatlon  was 
available  about  the  invisible  spinner.  Except  for  the  case 
Involving  the  word,  unspecified,  the  actual  probability 
distribution  that  governed  the  likelihood  of  an  invisible 
spinner's  landing  on  white  was  represented  by  a  single 
probability  value  that  was  based  on  previous  research  on 
the  measurement  of  the  meanings  of  probability  terms 
(Uallsten,  et  al,  in  press).  The  probability  terms  used  in 
this  experiment  were  assigned  probability  values  as 
follows:  doubtfu  1 :  0.18;  improbable:  0.32;  tossup : 

0.50;  good  chance:  0.64;  and  likely:  0.78.  Unspecified 
was  assigned  a  probability  value  of  0.50,  based  on  the 
reasonable  assumption  that  complete  Ignorance  of 
probability  Information  should  lead  one  to  assume  an 
attitude  of  indifference  between  any  two  mutually  exclusive 
and  exhaustive  outcomes. 

On  a  single  trial,  a  probability  spinner  appeared  on  a 


randomly  salaeted  side  of  the  screen,  and  one  of  the  six 
phrases  appeared  on  the  other  side.  The  proportion  of 
white  In  the  visible  spinner  was  varied  among  four  values 
uniquely  predetermined  for  each  of  the  six  phrases  with 
which  It  was  matched.  The  phrases  "likely  to  land  on 
white"  and  "good  chance  to  land  on  white"  were  matched  with 
visible  spinners  that  had  proportions  of  white  of  0.45, 
0.62,  0.79,  and  0.95.  Phrases  "doubtful  to  land  on  white" 
and  "lmprobab 1 e  to  land  on  white"  were  matched  with  visible 
spinners  that  had  proportions  of  white  of  0.05,  0.22,  0.39, 
and  0.55.  The  phrases  "tossup  to  land  on  white"  and 
"unspecified  to  land  on  white"  were  matched  with  visible 
spinners  with  proportions  of  white  of  0.30,  0.50,  0.50, 
and  0.70. 

To  Incorporate  the  concept  of  outcome  desirability  In 
the  experiment,  each  spinner's  landing  on  white  had 
associated  with  It  an  independent  point  value.  These 
values  were  either  >500,  -500,  or  0  points.  In  all  cases, 
the  value  of  a  spinner's  landing  on  red  was  0  points. 

There  were  three  different  conditions  of  desirability 
presented.  One  condition  involved  a  desirability  factor  of 
♦500  points  associated  with  the  visible  spinner  and  -500 
points  associated  with  the  probability  phrase.  In  the 
second  condition  the  signs  of  these  desirability  factors 
were  reversed.  The  third  condition  had  desirability 
factors  of  0  points  associated  with  both  the  visible 
spinner  and  the  probability  phrase. 


At  the  end  of  the  experiment,  subjects  answered  a  few 
questions  concerning  their  response  strategies  and  their 
understanding  of  the  instructions.  This  manipulation  check 
consisted  of  •  brief  written  multiple  choice  questionnaire. 

The  sequence  of  events  on  a  single  trial  was  as 
follows : 

1.  A  randomly  selected  screen  was  displayed  to  the 
subject.  On  one  side  of  the  screen  was  a  spinner  and  the 
desirability  value  associated  with  that  spinner's  landing 
on  white.  On  the  other  side  of  the  screen  was  one  of  the 
six  probability  phrases  referring  to  the  likelihood  of  an 
invisible  spinner's  landing  on  white  and  the  desirability 
value  associated  with  that  spinner's  landing  on  white. 
Traversing  the  width  of  the  screen  at  the  bottom  was  a  line 
segment  with  an  arrow  positioned  in  the  middle. 

2.  The  subject  indicated  which  spinner  (visible  or 
invisible)  he  or  she  judged  to  be  more  likely  to  land  on 
white  by  using  a  Joystick  to  position  the  arrow  along  the 
line  segment.  Moving  the  arrow  toward  one  or  the  other  end 
of  the  line  segment  indicated  stronger  confidence  in  the 
Judgment  that  the  spinner  on  that  side  of  the  screen  would 
land  on  white.  The  arrow  could  be  positioned  at  any  one  of 
200  points  along  the  line  segment,  but  there  were  only 
three  hash  marks  visible  to  the  subJect--one  at  each  end 
and  one  in  the  middle  of  the  line  segment. 

3.  After  the  arrow  was  positioned,  the  subject  pushed 
a  button  on  the  Joystick  assembly  that  caused  the  spinners 
to  "spin”.  The  subject  did  not  actually  see  the  spinners 
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spinning  and  was  not  told  the  outcome  (white  or  red)  of  an 
individual  spinner.  However,  a  noise  effect  simulated 
spinning  while  the  word  "spinning*  appeared  at  the  top  of 
each  side  of  the  screen.  The  outcome  of  each  spinner  was 
based  on  the  probability  distributions  described  above. 

4.  If  either  or  both  spinners  landed  on  white,  the 
correspond  1 ng  desirability  values  were  added  to  or 
subtracted  from  the  subject’s  cumulative  total  of  points. 
This  total  was  displayed  and  updated  on  every  trial  in  a 
window  near  the  top  of  the  screen 

5.  The  subject  pu?".ed  a  button  on  the  Joystick 
assembly  to  initiate  the  next  trial. 

Design 

There  were  six  probability  phrases  matched  with  four 
different  probability  spinners  each.  Also,  each  spinner- 
phrase  pair  had  associated  with  it  one  of  three  conditions 
of  desirability.  This  created  a  total  of  72  trials  which 
constituted  a  block.  Subjects  performed  one  block  of 
trials  in  random  order  on  each  of  two  days.  Sessions  were 
separated  by  24  to  48  hours.  There  was  no  practice,  but 
subjects  read  detailed  instructions  while  viewing  the  first 
randomly  selected  screen  of  their  session. 

Results 

Reliability 

The  first  step  was  to  assess  the  reliability  of  the 
data  by  calculating  the  linear  correlation  between  each 
subject’s  responses  over  the  two  sessions.  Table  1  shows 
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both  a  staple  Pearson  correlation  of  each  subject's 
responses  on  the  two  days,  as  well  as  a  pooled  correlation* 
Pooling  was  achieved  by  standardizing  the  responses  so  that 
they  had  a  mean  of  zero  for  each  of  the  six  probability 
phrases.  As  can  be  seen  In  the  table,  this  adjustment  did 
not  significantly  change  the  correlations.  The  oean 
correlation  over  all  subjects  between  responses  for  session 
one  and  session  two  was  0.61  for  both  the  simple  and  pooled 
cases.  The  simple  correlations  were  above  0.80  for  four 
subjects  and  above  0.70  for  ten  subjects. 

Analyses  on  Individual  Phrases 

The  three  main  factors  in  the  experimental  design  for 
each  of  the  six  probability  phrases  were  (a)  the 
probability  of  the  visible  spinner  landing  on  white  (four 
levels),  (b)  the  outcome  desirability  combination  (three 
levels),  and  (c)  session  (two  levels).  Figure  1  shows 
mean  responses  for  each  phrase  as  a  function  of 
probability,  ignoring  desirability  level.  Responses  are 
scaled  so  that  0  means  certain  that  the  Invisible  spinner 
is  more  likely  to  land  on  white,  200  means  certain  that  the 
visible  spinner  Is  more  likely  to  land  on  white,  and 
Intermediate  values  designate  Intermediate  degrees  of 
certainty.  As  expected,  responses  increase  with  visible 
spinner  probability.  Mean  responses  at  each  desirability 
condition  for  each  phrase,  Ignoring  probability  level,  are 
shown  as  the  first  six  rows  of  Table  2. 

The  main  analyses  sought  to  determine  the  effect,  If 
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any*  of  th«  desirability  values  on  subjects'  responses. 

The  Initial  analyses  involved  six  distinct  4x3x2 
(Probability  x  Desirability  x  Session)  repeated  measures 
ANOVAs,  one  for  each  probability  phrase.  The  ANOVAs  were 
performed  in  the  manner  recommended  by  Winer  (1971)*  in 
which  the  error  term  for  each  effect  was  the  interaction  of 
that  effect  with  the  factor  of  subjects. 

Subjects'  responses,  scaled  such  that  a  higher  value 
of  the  response  indicated  a  stronger  confidence  that  the 
visible  spinner  would  land  on  white,  was  the  dependent 
variable.  It  was  hypothesized  that  mean  responses  would 
increase  as  the  level  of  spinner  probability  Increased,  as 
they  do  (see  Figure  1).  No  other  response  pattern  would  be 
appropriate  if  the  subjects  believed  that  the  spinners  were 
fair.  The  main  hypothesis  of  the  experiment,  however,  was 
that  mean  response  values  would  be  lowest  for  the  negative 
splnner/posltl ve  phrase  desirabilities,  and  greatest  for 
the  positive  splnner/negatl ve  phrase  desirabilities. 

The  results  of  these  analyses  are  shown  in  Table  3. 

Session  was  not  a  significant  factor  for  any  of  the  six 
probability  phrases.  As  expected,  the  probability  of  the 
visible  spinner  landing  on  white  was  significant  in  the 
appropriate  direction  for  all  six  probability  phrases. 

From  Tables  2  and  3»  it  can  be  seen  that  level  of 
desirability  was  significant  in  the  hypothesized  direction 
for  the  probability  phrases,  doubtful .  good  chance,  and 
likely.  It  was  significant,  but  with  somewhat  unexpected 
mean  response  values,  for  the  probability  phrase, 


improbable.  Desirability  was  not  significant,  but  had  mean 
response  values  In  the  hypothesized  direction  for  the 
probability  phrases,  tossup  and  unspecified. 

Analyses  on  Phrase  Pairs 

In  order  to  Increase  power,  the  phrases  were  combined 
into  three  palrs--high  probability  (good  chance  and 
likely),  middle  probability  (tossup  and  unspecified),  and 
low  probability  (doubtful  and  improbable)-- >and  a  2  x  4  x  3 
(Phrase  x  Probability  x  Desirability)  ANOVA  was  performed 
on  each  pair.  There  was  no  hypothesized  pattern  of  mean 
responses  for  the  probability  phrase  factor,  so  it  was  not 
expected  to  be  significant.  The  mean  responses  for  each 
phrase  pair  at  each  level  of  desirability,  ignoring 
probability  level,  are  shown  as  the  last  three  rows  of 
Table  2.  Mean  responses  for  each  phrase  pair  as  a  function 
of  probability.  Ignoring  desirability  level,  are  plotted  In 
Figure  2. 

The  results  of  these  ANOVAs,  shown  in  Table  4,  reveal 
that  probability  phrase  was  not  significant  in  any  of  the 
three  ANOVAs,  while  the  probability  of  the  visible  spinner 
landing  on  white  was  significant  in  the  hypothesized 
direction  In  every  case.  Desirability  was  significant  with 
the  predicted  response  pattern  for  both  the  high  and  the 
low  probability  phrases,  but  not  for  the  middle  probability 
phrases.  The  interaction  of  probability  with  desirability 
was  not  significant  in  any  of  these  analyses. 

As  can  be  seen  in  Figures  1  and  2,  the  probability 
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factor  had  a  generally  large  effect.  In  contrast,  however, 
when  the  10  desirability  factor  was  significant,  the  effect 
was  rather  small,  as  shown  In  Table  2.  In  general,  the 
high  probability  terms,  good  chance  and  likely,  showed  much 
larger  effects  of  both  desirability  and  objective 
probability  than  did  the  low  probability  terms,  doubtful 
and  Improbable.  The  middle  probability  terms  obviously 
showed  small  effects  of  desirability,,  since  they  were  non¬ 
significant,  but  showed  rather  large  effects  of  objective 
probability. 

The  El  1 sberg  Paradox 

Ellsberg  (1961)  claimed  that  people  commonly  violate  a 
fundamental  axiom  of  rationality  by  preferring  to  bet  on 
outcomes  stated  under  conditions  of  risk  rather  than  on 
outcomes  stated  under  conditions  of  Ignorance  or  high 
levels  of  ambiguity,  even  though  the  best  estimate  of  the 
probabilities  of  all  the  outcomes  under  consideration  was 
0.50.  This  finding,  known  as  the  Ellsberg  paradox,  would 
be  obtained  In  the  present  study  If  subjects  accorded  a 
higher  subjective  probability  to  the  objective  probability 
of  0.50  than  to  the  phrases,  tossup  and  unspecified,  or  in 
other  words  if  subjects  gave  mean  responses  significantly 
above  the  neutral  response  of  100  when  these  two  phrases 
were  each  matched  with  a  visible  spinner  with  a  0.50 
probability  of  landing  on  white.  In  contrast,  a  major 
hypothesis  of  this  study  was  that  independent  outcome 
desirability  biases  the  subjective  probability  toward  the 
outcome  with  the  relatively  favorable  desirability,  thereby 
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overwhelming  any  effects  due  to  ambiguity  avoidance. 

Simple  t  tests,  comparing  the  appropriate  mean  responses  to 
100,  are  suitable  for  testing  this  hypothesis.  The  results 
of  this  analysis,  shown  In  Table  5,  reveal  that  only  with 
the  phrase,  tossup,  under  negative  splnner/posltl ve  phrase 
desirability,  was  the  mean  response  significantly  below 
100.  Thus,  in  this  instance,  10  desirability  appeared  to 
produce  a  bias  toward  the  outcome  with  the  relatively 
favorable  desirability  and  the  results  predicted  from  the 
Ellsberg  paradox  failed  to  hold.  Notably,  however,  in  no 
case  were  the  results  expected  on  the  basis  of  those  from 
Ellsberg  obtained  at  a  significant  level. 

Analysis  of  the  Questionnaire  Data 

The  results  of  the  questionnaire  given  to  subjects  at 
the  end  of  the  experiment  showed  that  eighteen  out  of 
twenty  subjects  understood  that  the  spinners  were  fair  and 
that  their  responses  had  no  effect  on  the  probability  of 
either  the  visible  or  invisible  spinner  landing  on  white. 
Six  questions,  phrased  like  the  first  one  in  the  Appendix, 
but  with  a  slightly  different  situation  in  each  case,  were 
used  to  assess  subjects'  understanding  of  this  point.  Four 
questions,  phrased  like  the  second  one  in  the  Appendix, 
revealed  that  nine  subjects  out  of  the  twenty  thought  that 
their  responses  had  some  effect  on  whether  or  not  they  won 
points.  Additionally,  a  final  question,  which  was 
identical  to  the  third  question  in  the  Appendix,  verified 
subjects'  understanding  of  the  two  main  ideas  of  the 
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Instructions,  and  explicitly  asked  subjects  to  explain 
their  response  strategy  when  presented  with  the  probability 
tern,  unspecified. 

Given  the  above  results,  it  was  decided  to  perfora 
separate  analyses  on  the  eleven  subjects  who  seeaed  to 
understand  the  instructions  perfectly  and  on  the  nine  who 
seeaed  not  to.  The  2  x  A  x  3  ANOVAs,  as  described  above 
for  the  three  pairs  of  probability  phrases,  were  perforaed 
separately  for  the  two  groups  of  subjects,  for  a  total  of 
six  analyses,  with  results  shown  in  Table  6. 

Probability  phrase  was  significant  only  for  the  phrase 
pair,  tossup  and  unspecified,  for  those  who  understood  the 
instructions,  while  the  probability  of  the  visible  spinner 
landing  on  white  was  significant  in  the  predicted  direction 
in  every  case.  Desirability  was  significant  in  the 
hypothesized  direction  for  the  high  probability  phrase 
pair,  good  chance  and  likely,  for  both  groups  of  subjects. 

For  the  low  probability  phrase  pair,  doubtful  and 
improbable,  desirability  was  significant  in  an 
inappropriate  pattern  for  those  subjects  who  did  not 
understand  the  instructions,  and  was  not  significant,  but 
in  the  hypothesized  direction  for  those  subjects  who  did 
understand.  Desirability  was  not  significant  for  either 
group  of  subjects  for  the  middle  probability  phrase  pair, 
tossup  and  unspecified.  The  subjects  who  did  not 
understand  the  instructions  had  mean  responses  in  the 
appropriate  pattern,  however,  while  those  subjects  who  did 
understand  the  instructions  had  an  Inappropriate  pattern  of 


mean  responses.  The  Interaction  of  probability  and 
desirability  was  not  significant  In  any  of  these  cases. 
Reanalyses  on  Most  Rel lable  Subjects 

Analyses,  similar  to  the  ones  described  above,  were 
performed  on  the  ten  subjects  with  between  session 
correlations  of  responses  at  or  above  the  median  level  of 
0.70.  Individual  phrase  analyses  showed  that,  for  every 
phrase,  the  probability  of  the  visible  spinner  landing  on 
white  was  significant  In  the  hypothesized  direction. 
However,  only  for  the  phrase,  likely,  was  the  spinner 
desirability  effect  significant,  and  this  effect  was  not 
precisely  in  the  hypothesized  direction.  No  other  effects 
or  interactions  were  significant. 

For  the  analyses  on  phrase  pairs,  the  probability  of 
the  visible  spinner  landing  on  white  was  significant  in  the 
hypothesized  direction  In  every  case.  For  the  low 
probability  phrases,  spinner  desirability  was  significant 
In  the  hypothesized  direction,  while  for  the  high 
probability  phrases,  It  was  significant,  but  not  exactly  In 
the  hypothesized  pattern.  Spinner  desirability  was  not 
significant  for  the  middle  probability  phrases.  In  short, 
these  analyses  did  not  produce  any  better  results  than  had 
been  obtained  previously  on  all  twenty  subjects. 

Discussion 

In  general,  the  results  show  that  10  desirability 
affects  Judgments  of  relative  probability  when  the 


uncertainty  la  represented  by  verbal  expressions.  The 
probability  phrases,  doubt fu  1 ,  good  chance,  and  likely, 
showed  this  effect  clearly  when  analyzed  separately.  The 
phrase.  Improbable,  was  also  significantly  affected  by 
deslrabl 1 Ity,  but  did  not  show  precisely  the  hypothesized 
pattern  of  responses.  The  middle  phrases,  tossup  and 
unspecified,  showed  the  expected  pattern  of  mean  responses, 
but  the  results  were  not  statistically  significant. 

The  results  of  the  analyses  on  pairs  of  phrases  showed 
that  desirability  was  significant  In  the  hypothesized 
direction  for  the  high  pair,  good  chance  and  likely,  as 
expected.  The  Increased  power  of  this  analysis  also 
produced  a  significant  desirability  effect  In  the 
appropriate  direction  for  the  low  pair,  doubtful  and 
Improbable.  The  middle  pair,  tossup  and  unspecified,  still 
failed  to  achieve  significance  for  the  desirability  effect, 
although  the  pattern  of  responses  was  In  the  hypothesized 
direction . 

Differential  Effects 

The  results  of  this  experiment  Indicate  a  clear 
difference  In  the  effects  of  desirability  on  the  low, 
middle,  and  high  probability  phrases.  Any  explanation  of 
the  overall  effect  of  desirability  on  judgments  under 
ambiguity  and  Ignorance  must  take  this  finding  Into 
account. 

Judged  meanings  of  phr ases.  The  low  phrases, 
doubtfu 1  and  lmprobab 1 e,  showed  smaller  effects  of  both 
objective  probability  and  desirability  than  d  '.d  the  high 


phrases,  good  ehanea  and  likely.  Other  research  (Vallsten, 
Flllenbaum,  A  Cox,  1986)  has  also  shown  that  low 
probability  phrases  are  less  affected  by  context  than  are 
neutral  and  high  probability  phrases.  Context  In  that  case 
referred  to  the  base  rate  of  occurrence  of  events.  A 
possible  reason  that  context  has  less  effect  on  low  than  on 
high  phrases  might  be  that  the  meanings  of  low  phrases  are 
further  from  the  center  of  the  probability  Interval  than 
are  the  meanings  of  high  phrases.  This  would  give  the 
meanings  of  high  probability  phrases  more  freedom  to 
undergo  shifts  when  Influenced  by  factors  such  as 
desirability  or  objective  probability  value. 

The  data  from  this  experiment  are  not  suitable  for 
precisely  determining  the  best  judged  meanings  of  the 
phrases.  By  examining  the  data  for  each  subject  averaged 
over  all  levels  of  desirability,  however,  one  can  note  at 
what  approximate  point  the  phrase  and  probability  were 
judged  equal  (l.e.  where  the  mean  response  was  100).  Out 
of  40  such  determinations  for  the  low  terms,  26  were 
located  below  the  probability  value  of  0.22.  Eleven  of 
these  26  determinations  were  for  doubtf u 1  and  the  remaining 
15  were  for  Improbab 1 e.  In  contrast,  the  high  terms  had 
only  3  out  of  40  determinations  above  the  probability  value 
of  0.79,  all  three  occurring  for  the  phrase,  good  chance. 
This  Indicates  that  the  best  judged  meanings  for  high 
probability  phrases  are  less  extreme,  on  average,  than  they 
are  for  low  probability  phrases. 


Precision  of  neinl n 


A  reason  for  the  lack  of 


significant  results  for  the  middle  probability  terms  may 
stem  from  the  relative  precision  of  their  meanings.  Tossup 
was  the  most  specific  of  all  the  terms  used  in  this  study, 
with  a  relatively  precise  meaning  of  0.50.  In  contrast, 
unspecified  would  seem  to  be  the  least  specific  of  all  the 
terms  used  in  this  experiment.  However,  the  results  of  the 
questionnaire  (see  Appendix,  question  3)  indicated  that 
unspecified  was  also  treated  as  having  a  relatively  precise 
meaning  of  C.jZ  probability.  Thirteen  of  the  twenty 
subjects  explicitly  mentioned  the  0.50  probability  in  the 
visible  spinner  as  the  cutoff  point  for  deciding  whether 
ths  visible  or  the  Invisible  spinner  was  more  likely  to 
land  on  white.  The  meanings  of  both  tossup  and  unspecified 
may  therefore  have  been  more  impervious  to  the  effects  of 
Independent  outcome  desirability  than  the  meanings  of  the 
other  phrases  used  in  this  study,  resulting  in  the  small, 
non-significant  results  reported  here. 

Unfortunately,  the  above  result  and  interpretation 
also  imply  that  the  phrase,  unspecified,  may  not  truly 
represent  Ellsberg's  condition  of  "complete  ignorance".  It 
may  be  more  closely  related  to  a  condition  of  ambiguity. 

Shifts  in  subjective  v a  1 ue.  Previous  research  (Irwin 
A  Graee,  1969;  Morlock  A  Hertz,  1964;  Crandall,  Solomon,  A 
Kellaway,  1955)  showed  that  10  desirability  caused  a 
significant  shift  in  the  subjective  values  accorded  to 
objective  probabilities,  with  the  largest  shifts  found  near 
the  middle  of  the  probability  range.  In  the  present  study, 
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however,  this  pattern  of  results  did  not  occur.  Note  that 
it  cannot  be  determined  whether  the  significant  effects  of 
desirabi  1  i ty  found  at  the  low  and  high  ends  of  the 
continuum  are  due  to  shifts  in  the  subjective  values 
accorded  the  visible  probabi lities  or  to  changes  in  the 
meanings  of  the  phrases.  -However,  the  lack  of  any 
significant  effects  due  to  desirability  in  the  middle  range 
of  probability  would  seem  to  indicate  that  only  very  small 
shifts,  if  any,  occurred  in  the  subjective  probability 
accorded  to  the  visible  spinner  in  that  range. 

That  the  shifts  in  subjective  value  accorded  the 
visible  spinner  probability  were  not  significant  (for  the 
middle  range  of  probability,  at  least)  may  relate  to  the 
fact  that  this  experiment  is  fundamentally  different  from 
the  earlier  studies  of  Independent  outcome  desirability. 
That  is,  subjects  were  never  before  required  to  compare  the 
relative  likelihoods  of  probabilities  and  probability 
phrases.  The  task  of  making  this  type  of  comparison  may 
Interact  with  desirability  or  produce  effects  that  add  to 
those  of  desirability.  One  such  effect,  discussed  further 
below,  is  ambiguity  aversion.  For  example,  since  there  is 
some  evidence  that  the  middle  probability  phrases  were  the 
most  precise  in  meaning,  and  thus  the  least  ambiguous,  it 
should  not  be  surprising  if  ambiguity  aversion  effects  were 
smallest  for  these  terms. 

Asymmetry  of  effects.  One  interesting  facet  relating 
to  this  1  n t e r pr e t a t i on  of  the  results  is  that  the  10 


desirability  effect  was  generally  not  symmetric.  That  is, 
for  four  of  the  six  phrases  Call  except  doubtful  and 
unspecified),  the  effect  was  greater  for  negative 
spinner/positive  phrase  desirability  than  it  was  for  the 
opposite  type  of  desirability.  This  iaplies  that  either 
the  Judged  meaning  of  the  phrase  Increased  more,  or  that 
the  subjective  value  accorded  the  objective  probability 
decreased  more  for  this  condition  than  for  the  opposite 
one.  One  interpretation  of  this  result  is  that  people 
noraally  have  a  bias  against  ambiguity,  and  towards  firm 
probabilities,  as  previous  research  has  shown  (Ellsberg, 
1961;  Becker  &  Brownson,  1964;  Yates  &  Zukowskl.  1976; 
Einhorn  A  Hogarth,  1986).  Further  evidence  for  this  point 
is  given  in  Table  2,  where  the  mean  responses  at  zero 
desirability  are  all  greater  than  100,  indicating  an 
avoidance  of  ambiguity.  Therefore,  attempts  to  make  the 
ambiguity-avoidance  bias  stronger  will  show  fairly  small 
effects.  In  contrast,  attempts  to  Induce  the  opposite  type 
of  bias  may  show  larger  effects. 

Membership  functions.  Another  explanation  for  the 
results  of  this  experiment  incorporates  the  concept  of 
membership  functions.  There  are  two  commonly  encountered 
shapes  of  membership  functions  for  probability  terms:  (a) 
single-peaked,  and  (b)  monotonlc  (Wallsten,  et  al,  in 
press;  Rapoport,  et  al,  in  press).  Figure  3  shows  some 
examples  of  the  different  types  of  membership  functions  one 
might  encounter  in  this  experiment. 

In  order  to  link  the  results  from  this  experiment  to 
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the  concept  of  membership  functions  one  oust  posit  some 
fairly  strong  assumptions.  First,  it  must  be  assumed  that 
unique  membership  functions  exist  for  each  probability 
phrase  and  that  these  functions  are  generally  of  a 
monotonic  or  single-peaked  shape.  Secondly,  it  oust  be 
assumed  that  these  membership  functions  have  a  maximum, 
which  may  occur  at  either  a  single  point  or  over  a  range  of 
values.  The  third  assumption,  which' is  the  most  tenuous, 
is  that  In  Judging  how  much  more  likely  one  spinner  rather 
than  the  other  is  to  land  on  white,  the  subject  focuses 
only  on  how  well  the  displayed  objective  probability  is 
described  by  the  phrase  associated  with  the  invisible 
spinner.  In  other  words,  the  response  depends  only  on  the 
value  of  that  objective  probability  in  that  phrase's 
membership  function.  Thus,  if  an  objective  probability 
with  the  value  1.0  in  a  phrase's  membership  function  were 
paired  with  that  phrase,  the  subject  would  consider  both 
the  visible  and  invisible  spinners  equally  likely  to  land 
on  white,  and  would  leave  the  arrow  in  the  middle  of  the 
response  line. 

Recall  that  the  response  line  is  scaled  0  (definite 
that  the  Invisible  spinner  is  more  likely  to  land  on  white) 
to  200  (definite  that  the  visible  spinner  is  more  likely  to 
land  on  white).  Given  the  above  assumptions,  responses  can 
be  transformed  to  membership  function  values  by  the 
following  formula: 

m  ( p )  *  1  -  [(  100  -  x)  /  100  ]  , 


where  x  €  [0,  200]  Is  the  response. 

There  are  other  assumptions  which  give  a  different 
interpr station  to  the  best  judged  meaning  of  a  probability 
phrase.  For  example*  it  has  been  suggested  that  subjects 
may  think  of  the  low,  central*  and  high  probability  values 
for  a  given  phrase  and  then  perform  a  type  ef  weighted 
average  of  these  values  to  derive  their  best  Judged  meaning 
of  the  phrase  (Wallsten,  1986).  Depending  on  the  weights 
given  to  each  of  these  probability  values*  the  best  judged 
meaning  may  or  may  not  occur  at  the  peak  of  the  membership 
function  for  the  given  phrase.  This  will  be  discussed  in 
more  detail  below. 

Given  the  three  assumptions  initially  described  above, 
from  each  of  the  low*  middle*  and  high  probability  phrase 
pairs,  40  (20  subjects  by  2  phrases)  membership  functions 
can  be  generated.  Ignoring  the  desirability  factor 
temporarily*  and  using  mean  responses  averaged  over  all 
levels  of  desirability,  it  was  found  that  the  vast  majority 
(89%)  of  the  derived  membership  functions  were  single- 
peaked.  These  results  are  shown  as  the  last  three  columns 
in  Table  7. 

Next*  the  responses  were  examined  at  each  level  of 
desirability  to  determine  if  the  desirability  factor  had  an 
effect  on  the  shape  of  subjects*  membership  functions. 

These  results*  displayed  in  the  first  nine  columns  of  Table 
7,  show  that  there  was  no  clear  effect  on  the  shape  of 
subjects*  membership  functions  due  to  deslrabl 1 lty*  since 
the  total  number  of  monotonic  membership  functions  under 


each  level  of  desirability  was  about  the  sane  (12  [10S],  11 
C9IJ,  and  16  C131])<  The  zero  desirability  condition  had 
the  fewest  number  of  other-shaped  membership  functions*  but 
this  could  simply  mean  that  the  desirability  factor 
introduced  more  variability  in  subjects'  responses. 
Individual  subjects  did  have  differently  shaped  functions 
depending  on  desirability  level*  however*  which  accounts 
for  the  discrepancy  between  this  analysis  and  the  preceding 
one*  in  which  a  total  of  only  seven  monotonic  membership 
functions  were  found. 

One  finding  that  is  the  same  in  both  analyses  and 
consistent  with  other  research  (Wallsten,  et  al*  in  press) 
is  that  aonotonlc  functions  are  more  prevalent  among  the 
lower  probability  phrases  than  among  the  higher  ones. 
However*  the  number  of  monotonlc  membership  functions  found 
in  this  study  is  much  smaller  than  has  been  normally  found 
in  other  research  (Wallsten*  et  al*  in  press;  Rapoport* 
Wallsten*  &  Cox*  in  press).  This  may  indicate  that  nean 
responses  of  100  do  not  represent  the  peak  values  of  the 
membership  functions*  but  rather  the  weighted  average  of 
low,  central,  and  high  probability  values  relevant  to  a 
given  probability  phrase.  Under  this  interpretation,  it  is 
possible  that  many  of  the  membership  functions  labeled  as 
single-peaked  could  actually  be  monotonlc*  given  the 
appropriate  set  of  weights  used  in  the  averaging  process. 
These  weights  are  unknown  parameters*  however*  which  cannot 
be  determined  from  the  present  data. 


Based  on  the  assuaptions  Initially  listed  above, 
desirability  seemed  to  have  no  effect  on  the  shapes  of  the 
derived  aeobershlp  functions.  Thus,  it  is  hypothesized 
Instead  that  10  desirability  caused  a  shift  in  the  location 
of  the  membership  function  for  a  given  tera.  When  the 
desirability  was  positive  for  the  spinner  and  negative  for 
the  probability  phrase,  the  membership  function  was  shifted 
to  the  left  of  where  it  was  when  there  was  no  desirability 
(toward  lower  probability  values).  When  the  desirability 
was  negative  for  the  spinner  and  positive  for  the 
probability  phrase,  the  membership  function  was  shifted  to 
the  right  of  where  it  was  when  there  was  no  desirability 
(toward  higher  probability  values).  Figure  4  shows  this 
shift  for  the  three  main  types  of  membership  functions  that 
were  encountered  in  this  experiment. 

Using  this  model,  one  can  explain  the  effect  of 
desirability  on  the  probability  terms,  doubtfu 1 .  good 
chance,  and  likely,  as  consisting  of  a  significant  shifting 
of  the  location  of  the  membership  functions  for  these 
terms.  For  the  term,  improbable,  the  shift  was  not 
completely  made  for  the  case  of  positive  spinner 
desirability.  A  possible  reason  for  this  is  that  the 
membership  function  for  Improbable  under  conditions  of  no 
desirability  may  be  located  near  the  bottom  of  the  range  of 
probability.  Thus,  there  may  not  have  been  enough  room  for 
a  significant  shift  to  the  left,  as  predicted  for  the 
positive  splnner/negati ve  phrase  desirability  effect.  The 
data  show  that  the  mean  responses  for  improbab 1 e  were 
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higher  than  those  for  the  other  low  probability  term, 
doubtful ,  when  responses  were  averaged  over  all  factors, 
and  also  when  these  responses  were  averaged  over  each  level 
of  deslrabl 1 ity.  These  results  Imply  that  the  meaning  of 
improbable  was  the  lowest,  among  all  the  phrases  used  in 
this  study,  in  terms  of  subjective  probability.  This  gives 
some  credence  to  the  notion  that  the  membership  function 
for  i.m£robab^e  may  be  so  close  to  the  bottom  of  the  range 
of  probability  values  that  it  precludes  a  significant  shift 
toward  lower  probabilities.  However,  the  finding  that 
lmprobab 1 e  had  a  lower  judged  meaning  than  did  doubtfu 1  is 
inconsistent  with  previous  research  (Wallsten,  et  al,  in 
press ) . 

A  different  interpretation  of  the  results  of  this 
experiment  involves  the  use  of  the  weighted  average  of  the 
low,  central,  and  high  probability  values  for  a  given 
phrase  (cf.  Wallsten,  1986).  The  pattern  of  results  for 
the  desirability  factor  can  be  explained  by  simply  assuming 
that  positive  splnner/negative  phrase  desirability  causes 
subjects  to  give  more  weight  to  the  low  probability  values, 
while  negative  splnner/posltlve  phrase  desirability  causes 
subjects  to  give  more  weight  to  the  high  probability 
values.  In  other  words,  when  the  phrase  describes  a 
potential  loss,  subjects  concentrate  more  on  the  low 
probability  for  that  phrase,  and  when  it  describes  a 
potential  gain,  they  concentrate  more  on  the  high 
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probability  for  that  phrase.  The  different  desirability 
effects  for  low.  middle,  and  high  probability  phrases  can 
be  explained  by  assuming  that  the  weights  used  in  the 
averaging  process  for  the  middle  probability  terms  were  all 
about  equal,  while  for  the  low  probability  phrases  they 
were  slightly  different  from  each  other,  and  for  the  high 
probability  phrases  they  were  even  more  different  from  each 
other.  Of  course,  further  research  is  necessary  to 
Independently  test  these  assumptions. 

The  El  1 sberg  Paradox 

Tests  of  the  Ellsberg  paradox  showed  an  effect 
opposite  to  Ellsberg's  hypothesis  under  one  condition  of 
desirability.  The  one  significant  result  in  this  analysis 
(See  Table  5)  showed  that  when  desirability  favored  the 
phrase,  subjects  considered  the  ambiguous  uncertainty  (the 
phrase,  tossup)  to  be  more  likely  than  the  precise  one  (the 
objective  probability  of  0.50).  This  is  consistent  with 
the  hypothesis  that  subjects’  responses  will  be  biased 
towards  the  outcome  with  the  relatively  favorable 
desirability. 

Further,  it  is  of  interest  that  the  results  predicted 
from  the  Ellsberg  paradox  did  not  occur  in  any  case.  That 
is,  subjects  never  accorded  a  significantly  higher 
subjective  value  to  the  objective  probability  of  0.50  than 
to  the  phrases,  tossup  and  unspecified.  Possibly,  Ellsberg 
was  dealing  with  betting  preferences,  while  the  present 
study  deals  with  Judgments  of  relative  likelihood.  Thus, 
the  Ellsberg  paradox  may  actually  represent  a  type  of 


ambiguity  aversion  In  a  gambling  scenario. 

If  the  term,  unspecified,  truly  represented  a 
condition  of  ignorance,  then  desirability  did  noc  exert  a 
strong  enough  effect  to  cause  subjects  to  consider  the 
condition  of  Ignorance  as  more  likely  than  the  condition  of 
risk.  Given  the  previous  discussion  of  the  fairly  precise 
meaning  of  unspecified,  however,  it  may  be  that  this  term 
represented  ambiguity  rather  than  ignorance. 

Differences  from  Previous  Research 

There  are  some  important  differences  between  these 
results  and  those  found  by  earlier  studies.  First,  it  was 
previously  found  that  the  effect  of  10  was  strongest  for 
objective  probabilities  of  0.50  (Irwin  &  Snodgrass,  1966; 
Mor lock  &  Hertz,  1964;  Crandall,  Solomon,  &  Kellaway, 

1955).  It  was  therefore  hypothesized  that  the  strongest 
effect  of  10  desirability  in  the  present  study  would  be 
found  in  the  case  where  the  probability  0.50  was  paired 
with  the  phrase,  tossup.  This  turned  out  to  be  one  of  the 
weakest  effects  in  the  experiment,  although  it  was  in  the 
appropriate  direction.  Another  interesting  difference  was 
that  the  high  terms  seemed  to  show  stronger  effects  of 
desirability  than  did  the  low  terms.  This  result  did  not 
occur  in  the  earlier  research  under  conditions  of  risk. 

Both  of  these  differences  may  be  the  result  of  this 
experiment's  requiring  a  judgment  of  relative  likelihood 
between  a  verbal  expression  of  ambiguity  and  an  objectively 
stated  probability,  whereas,  the  earlier  studies  dealt 


solely  with  objective  probabilities.  One  finding  froo  the 
earlier  research  on  Independent  outcome  desirability  that 
was  replicated  was  that  the  desirability  effect  was 
maintained  even  though  the  independent  outcomes  were 
probabilistic  (cf.  Irwin  &  Metzger.  1966). 

It  turned  out  that  the  nature  of  the  present  task  was 
problematic.  Subjects  were  asked  to  concentrate  on  making 
their  best  judgment  as  to  the  relative  likelihoods  of  the 
two  paired  events  on  each  trial.  They  were  told  that  the 
points  were  put  on  the  screen  to  help  them  pay  attention  to 
the  task  and  to  make  It  more  interesting.  Despite  the 
written  Instructions,  which  Indicated  that  all  outcomes 
were  based  solely  on  fixed,  pr edetermlned  probability 
values,  some  subjects  mentioned  after  the  experiment  that 
they  tried  to  figure  out  what  "system"  governed  the 
awarding  of  points.  The  questionnaire  given  to  subjects  at 
the  end  of  the  experiment  was  an  attempt  to  determine  how 
deeply  this  tendency  affected  subjects'  responses.  As 
pointed  out  above,  however,  the  questionnaire  did  not  seem 
to  provide  any  valid  information  on  this  Issue. 

Summary  and  Conclusions 

This  experiment  showed  that  independent  outcome 
desirability  Is  one  context  factor  that  appears  to  affect 
the  vague  meanings  of  probability  phrases.  Judgments  of 
relative  likelihood  were  found  to  be  biased  somewhat  toward 
the  outcome  with  the  relatively  favorable  deslrabi 1  tty. 
Given  certain  assumptions.  Independent  outcome  desirability 


effects  can  be  Interpreted  as  causing  shifts  in  the 
location  of  the  membership  functions  for  probability 
phrases,  without  changing  the  shape  of  the  membership 
functions.  A  different  explanation  could  involve  the  way 
in  which  desirability  affects  the  weighted  averaging 
process  used  to  derive  the  best  judged  meaning  for  a 
probability  phrase. 

The  most  plausible  explanation  of  the  10  desirability 
effects  would  need  to  involve  all  the  factors  relevant  to  a 
judgment  of  relative  likelihood  between  a  probability 
phrase  and  an  objective  probability.  Three  of  these 
factors,  discussed  above,  are:  (a)  the  subjective  value 
that  is  accorded  to  the  objectively  stated  probability,  (b) 
the  judged  meaning  of  the  probability  phrase,  and  (c> 
ambiguity  aversion.  It  would  be  desirable  to  study  each  of 
these  factors  in  isolation  within  the  context  of  examining 
the  meanings  of  probability  phrases. 
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Table  1 


Test-Retest  Correlations 


Subject 

Simple 

Pooled 

1 

0.69 

0.69 

2 

0.84 

0.83 

3 

-0.21 

-0.16 

4 

0.68 

0.69 

5 

0.75 

0.76 

6 

0.86 

0.86 

7 

0.47 

0.46 

8 

0.69 

0.69 

9 

0.81 

0.81 

10 

0.93 

0.92 

1 1 

0.77 

0.76 

12 

0.71 

0.72 

13 

0.72 

0.71 

14 

0.42 

0.42 

15 

0.76 

0.76 

16 

0.62 

0.63 

17 

0.79 

0.80 

18 

0.54 

0.53 

19 

0.68 

0.67 

20 

0.24 

0.22 

Mean 


0.61 


0.61 


Table  2 


Desirability  Effects  in  Terns  of  Mean  Response  Values 
for  Each  Phrase  and  Contained  over  Sinllar  Phrases 


Spinner  a 

-500 

0 

♦500 

Phrase  a 

♦  500 

0 

-500 

Doubtfu  1 

108.47 

1 12.09 

118.11 

Good  Chance 

97.77 

1 10.68 

115.56 

Inprobab 1 e 

111.21 

120.24 

118.51 

Likely 

94.99 

112.93 

115.98 

Tossup 

96.34 

101.39 

103.44 

Unspecified 

102.68 

103.32 

107.36 

Doubtful  & 
Inprobable 

109.84 

116.16 

1 18.31 

Good  Chance 
&  Likely 

96.38 

111.80 

115.77 

Tossup  & 
Unspecl f 1 ed 

99.51 

102.36 

105.40 
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Table  3 

F-Ratlos  from  ANOVAs  on  Individual  Probability  Phrases 


Phrase 

Sessions 

Probabl  lit  y*> 

Deslrabl lltyc 

Doubtf u 1 

0.86 

63.51 

ee 

5.02 

e 

Good  Chance 

0.00 

73.13 

ee 

5.67 

ee 

Improbable 

0.62 

51.37 

•  a 

5.53 

ee 

Likely 

1.14 

61.28 

ee 

22.90 

ee 

Tossup 

0.01 

76.60 

ee 

1.38 

Unspecified 

1.08 

36.11 

ee 

0.47 

a)  df  =  (1,19) 

b)  df  s  (3,57)  for  Doubtful,  Good  Chance,  Improbable,  and 

Likely 

df  s  (2,38)  for  Tossup  and  Unspecified 

c)  df  s  (2,38) 

•  £  <  0.05.  ••  £  <  0.01. 


Table  4 


50 


F-Ratios  froa  ANOVAS  on  Coablned  Probability  Phrases 


Phrase  Phrasea  probability^  Desirabi  litye  Probabi  1  ity<*  x 


Pair 

\ 

Desirabi llty 

Doubtful  A  3.39 

Improbable 

66.94 

ee 

6.81  •• 

0.78 

Good  Chance  0.00 

A  Likely 

78.46 

ee 

13.71  •• 

1.89 

Tossup  A  3*84 

Unspecified 

65.69 

ee 

1.24 

2.08 

a)  df  3  (1,19) 

b)  df  s  (3.57)  for  Doubtful  A  Inprobable,  Good  Chance  & 

Likely 

df  s  (2,38)  for  Tossup  A  Unspecified 

c)  df  s  (2,38) 

d)  df  s  (6,114)  for  Doubtful  A  Improbable,  Good  Chance  A 

Likely 

df  s  (4,76)  for  Tossup  A  Unspecified 
•  £  <  0.05.  ••  £  <  0.01. 


) 
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Table  5 

Tests  of  Whether  Mean  Responses  are  Significantly 
Below  100  for  the  Neutral  Phrases  vs.  0.50 


Spinner  s 

-500 

0 

♦  500 

Phrase  s 

♦  500 

0 

-500 

Tossup 

Mean  Response 

94.06 

*  97.58 

103.93 

T-Value 

-2.01  • 

-0.79 

1.26 

Unspecified 

Mean  Response 

98.00 

99.61 

105.06 

T-Value 

-0.48 

-0.11 

1.37 

•  £  <  0.05. 


) 


Table  6 


F-Ratlos  from  ANOVAs  for  Subjects  who 
Understood/Did  not  Understand  the  Instructions 


Phrase  Phrase  Probability 

Pair 

Deslrabl llty 

Probability  x 
Deslrabl llty 

Subjects  who 

Understood 

the  Instructions 

Doubtful  A 

0.79 

47.62  •• 

'3.25 

1.23 

Improbable 

(df)« 

(1.10) 

(3,30) 

(2,20) 

(6,60) 

Good  Chance 

0.81 

153.03  •• 

7.41  •• 

1.40 

&  Likely 

(d  f )  s 

(1,10) 

(3,30) 

(2,20) 

(6,60) 

Tossup  A 

5.86  • 

49.60  •• 

2.48 

0.31 

Unspecified 

(df)» 

(1,10) 

(2,20) 

(2,20) 

(4,40) 

Subjects 

who  did 

»,ot  Understand 

the  Instructions 

Doubtful  A 

4.75 

24.34  •• 

4.21  • 

0.52 

Improbable 

(  d  f  )  a 

(1,8) 

(3,24) 

(2,16) 

(6,48) 

Good  Chance 

2.51 

14.67  •• 

5.95  • 

1.14 

A  Likely 

(df)* 

(1,8) 

(3,24) 

(2,16) 

(6,48) 

Tossup  A 

0.02 

19.50  •• 

2.29 

0.93 

Unspecified 

(d  f  )  a 

(1,8) 

(2,16) 

(2,16) 

(4,32) 

•  £  <  0.05.  ••  £<0.01. 


Table  7 


Monotonic  (M),  Single-Peaked  (SP),  and  Other  (Q) 
Membership  Functions  for  Each  Phrase  and  Desirability  Level 
and  Averaged  over  All  Desirability  Levels 


Spinner  * 
Phrase  s 


-500 
♦  500 


H  SP  0  M  SP  0  •  M  SP  0  MS 


Low  phrases 

Doubtf u  1 

3  14 

3  2  14  4 

1  13  6 

2 

Improbable 

3  11 

6  5  12  3 

6  12  2 

3  ■ 

Sub-Total  6  25  9  7  26  7  7  25  8  5  33  2 


Tossup 
Unspecl fled 
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Figure  1 


Graph  of  Mean  Responses  as  a  Function  of  Probability  for 
Individual  Phrases,  Ignoring  Desirability 
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Figure  2 


Graph  of  Mean  Responses  as  a  Function  of  Probability  for 
Phrase  Pairs,  Ignoring  Desirability 
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Figure  3 


Types  of  Membership  Functions 
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Figure  4 

Hypothesized  Effect  of  Independent  Outcome  Desirability 

on  Membership  Functions 
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Appendix 
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WHITE:  -500 
8ED:  0 


WINNINGS: 

1000 


WHITE:  500 
RED:  0 
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LIKELY 
to  land  on 
white. 


\/ 


♦ 
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In  the  screen  drawn  above,  the  visible  spinner  is  on 
the  left  and  the  word.  Likely,  is  on  the  right.  Inside  the 
spinner,  the  letters  W  and  R  stand  for  the  colors  white  and 
red,  respectively.  Suppose  that  you  viewed  this  screen 
during  the  experiment  and  you  positioned  the  arrow 
approximately  where  it  is  in  the  drawing  above. 

Given  that  you  have  the  arrow  positioned  on  the  right 
side  of  the  line  segment,  what  effect  does  this  have  on  the 
likelihood  of  the  visible  spinner's  landing  on  white? 

A)  It  Increases  the  likelihood  of  the  visible  spinner's 
landing  on  white. 

B)  It  decreases  the  likelihood  of  the  visible  spinner's 
landing  on  white. 

C)  It  has  no  effect  on  the  likelihood  of  the  visible 
spinner's  landing  on  white. 
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WHITE:  -500 
RED:  0 


WINNINGS: 

1000 


WHITE:  500 
RED:  0 


LIKELY 
to  land  on 
white. 


In  the  screen  drawn  above,  the  visible  spinner  Is  on 
the  left  and  the  word,  Likely,  is  on  the  right.  Inside  the 
spinner,  the  letters  W  and  R  stand  for  the  colors  white  and 
red,  respectively.  Suppose  that  you  viewed  this  screen 
during  the  experiment  and  you  positioned  the  arrow 
approximately  where  it  is  in  the  drawing  above. 

Now,  it  turned  out  that  both  the  visible  spinner  and 
the  invisible  spinner  landed  on  white.  In  this  case, 
describe  what  happens  to  your  cumulative  total  of  points: 

A)  It  Increases  by  500  points. 

B)  It  decreases  by  500  points. 

C)  It  Increases  by  1000  points. 

D)  It  decreases  by  1000  points. 

E)  Nothing  happens  to  your  cumulative  total  of  points. 


3)  a)  In  general,  did  you  think  that  where  you  placad  tha 
arrow  Influenced  tha  outcona  of  tha  splnnars? 
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b)  Old  you  think  that  your  placement  of  tha  arrow  had 
an  affaot  on  tha  amount  of  points  that  you  could  win  or 
lose  on  a  given  trial? 

c)  What  guided  your  placement  of  tha  arrow  when  you 
were  presented  the  word*  "unspecified?" 
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ABSTRACT 

When  subjects  have  complete  knowledge  of  the 
probability  distribution  governing  a  set  of  outcomes,  their 
subjective  probability  estimates  have  been  found  to  be 
biased  towards  the  outcome  with  the  relatively  favorable 
desirability.  With  the  use  of  linguistic  probability 
expressions,  this  study  attempted  to  extend  this  finding  to 
situations  in  which  subjects  have  only  vague  knowledge  or 
no  knowledge  of  the  probability  distribution  relevant  to  a 
set  of  outcomes.  It  was  found  that  subjects'  comparisons 
were  biased,  in  varying  degrees  depending  on  the  particular 
phrase  under  consideration,  towards  the  relatively  more 
desirable  outcome.  This  finding  indicates  that  a  complete 
model  of  Judgment  under  uncertainty  must  Include  a  factor 
for  context  effects  such  as  outcome  desirability. 
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Introduction 


Ear l l #r  theories  of  judgment  under  uncertainty  (e.g. 
Knight,  1921;  Savage,  195*)  have  assumed  that  the  decision* 
maker  Is  a  rational  being,  conforming  to  basic  axioms  of 
probability.  This  study  examines  an  aspect  of  irrational 
decision-making;  namely,  the  ways  In  which  judgments  about 
uncertain  outcomes  are  affected  by  the  Independent 
desirability  of  those  outcomes.  The  Independent 
desirability  of  an  outcome  refers  to  the  value  of  the 
outcome  Itself,  independently  of  one's  prediction.  This 
study  extends  the  finding  (Marks,  1951;  Irwin  &  Snodgrass, 
1966;  Irwin  &  Metzger,  1966;  Slovlc,  1966)  that  Independent 
outcome  desirability  affects  subjective  probability.  In 
direct  opposition  to  a  fundamental  axiom  of  rationality. 

The  work  of  Irwin,  et  al.,  on  independent  outcome 
desirability  was  motivated  in  part  from  Irwin's  interest  in 
the  types  of  factors  affecting  people's  expectations  of 
outcomes.  He  held  that  there  were  cognitive  factors,  which 
would  lead  to  realistic  expectations,  as  well  as  affective 
factors,  which  would  lead  to  unrealistic  expectations 
(Irwin,  19**).  Underlying  this  research  may  have  been 
Irwin's  Intent  to  develop  a  more  complete  model  of  judgment 
than  the  subjectively  expected  utility  (SEU)  model.  The 
results  found  by  Irwin,  et  al.  Indicate  that,  at  the  least, 
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it  may  be  necessary  to  control  for  Independent  outcome 
desirability  In  SEU  models. 

Uncertainty  Is  a  broad  concept,  including  all  states 
of  knowledge  other  than  perfect  about  the  occurrence  of 
events.  Is  an  attempt  to  segment  the  construct  of 
uncertainty,  Ellsberg  (1961)  described  three  states  of 
knowledge  regarding  the  probabilities  of  future  events.  He 
labeled  these  conditions  "risk'*,  "ambiguity",  and  "complete 
Ignorance",  representing  precise  knowledge  of 
probabilities,  vague  or  imprecise  knowledge  of 
probabilities,  and  absolutely  no  information  about 
probabilities,  respectively.  If  the  probabilities  are 
known  to  be  either  exactly  0  or  exactly  1,  however,  this 
corresponds  to  a  situation  of  certainty. 

As  will  be  documented  below,  it  is  already  known  that 
under  conditions  of  risk,  subjective  probabilities  are 
positively  related  to  Independent  outcome  desirability. 

However,  people  commonly  make  decisions  based  on 
information  that  is  ambiguous  or  imprecise,  or  even  on  the 
basis  of  no  information  at  all,  which  corresponds  to 
Ellsberg's  states  of  ambiguity  and  complete  Ignorance, 
respectively.  This  study  examines  the  effect  of 
independent  outcome  desirability  on  judgments  under 
ambiguity  and  complete  Ignorance. 

There  are  at  least  two  major  ways  to  express 
uncertainty  in  an  ambiguous,  vague,  or  imprecise  manner. 

One  way  is  to  use  a  range  of  numerical  probability  values 
to  describe  the  probability  of  an  outcome,  while  the  other 
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Is  to  use  verbal  expressions  of  uncertainty.  The  latter 
was  used  In  the  present  study,  In  order  to  further 
Investigate  the  factors  that  affect  the  aeanlngs  of 
probability  teras. 

Literature  Review 

Rationality,  Uncertainty,  and  the  Ell sberg  Paradox 

For  people  to  be  rational  decl sion-aakers,  they  must 
confora  to  certain  basic  axloas  of  rationality.  One  of 
these  axloas  holds  that  choices  are  completely  ordered 
according  to  the  Judged  values  of  the  consequences  of  those 
choices.  Another  Important  axiom  is  the  sure-thing 
principle  (Savage,  1954),  according  to  which,  people's 
ordering  of  alternative  choices  should  be  unaffected  by 
adding  a  constant  to  the  value  of  the  consequences  of  each 
choice.  A  third  principle  requires  people  to  be  free  of 
"wishful  thinking"  (Radnor,  1972).  That  Is,  one's  ranking 
of  probabilities  of  events  should  be  independent  of  the 
consequences  of  those  events. 

These  axioms  of  rationality  are  not  predictive  of 
actual  behavior,  however.  Ellsberg  (1961)  has  shown  that 
certain  commonly  obtained  choice  patterns  are  In  violation 
of  the  first  two  of  these  axloas.  The  present  study  Is 
designed  to  examine  violations  of  all  three  of  these 
axloas,  but  the  primary  hypothesis  of  this  experiment  is 
that  decision-makers  will  consistently  violate  the  third 
principle  listed  above. 


4 


According  to  Ellsberg,  a  condition  of  risk  exists  when 
a  decision-maker  knows  with  certainty  the  probability 
distribution  over  a  set  of  outcomes.  A  state  of  complete 
Ignorance  exists  when  the  decision-maker  has  absolutely  no 
information  about  the  probability  distribution  over 
outcomes.  Ellsberg  showed  that  a  person's  ordering  of 
gambles  depends  upon  whether  that  person  is  operating  under 
a  condition  of  risk  or  a  condition  of  ignorance. 

Between  the  extremes  of  risk  and  complete  ignorance 
lies  the  state  of  ambiguity,  in  which  the  decision-maker 
can  rule  out  at  least  one  probability  distribution. 

However,  under  ambiguity,  more  than  one  probability 
distribution  remains  under  consideration,  and  the  decision¬ 
maker  does  not  have  enough  information  to  determine  which 
probability  distribution  is  operative.  One  of  the  purposes 
of  this  study  is  to  extend  Ellsberg's  results  to  situations 
of  ambiguity  represented  by  probability  phrases  such  as 
likely,  doubtful .  good  chance,  and  so  forth. 

The  importance  of  distinguishing  the  three  types  of 
uncertainty  becomes  apparent  in  light  of  the  Ellsberg 
paradox.  This  paradox  can  be  described  by  considering  a 
situation  in  which  there  exist  two  urns  containing  100  red 
and  black  balls  each.  The  proportion  of  red  and  black 
balls  in  Urn  1  is  completely  unknown,  whereas.  Urn  II 
contains  exactly  50  red  balls  and  50  black  balls.  Thus, 

Urn  I  corresponds  to  a  state  of  nearly  complete  ignorance, 
while  Urn  II  corresponds  to  a  state  of  risk.  Let  RedI, 
Black  I,  Red  1 1 ,  and  Blackll  represent  the  event  of  drawing  a 


red  ball  from  Urn  I ,  a  black  ball  from  Urn  I,  a  red  ball 
froa  Urn  II,  and  a  black  ball  froa  Urn  II,  respectively. 
Then,  the  parados  lies  in  typical  answers  to  the  following 
four  questions: 

1.  Which  do  you  prefer  to  bet  on,  RedI  or  BlackI,  or 
are  you  indifferent? 

2.  Which  do  you  prefer  to  bet  on,  Redll  or  Blackll, 

« 

or  are  you  indifferent? 

3.  Which  do  you  prefer  to  bet  on,  RedI  or  Redll,  or 
are  you  Indifferent? 

4.  Which  do  you  prefer  to  bet  on,  BlackI  or  Blackll, 
or  are  you  indifferent? 

Most  people  answer  the  first  two  questions  with 
indifference  responses,  implying  that  they  feel  that 
Pr(Redl)  a  Pr(Blackl)  and  Pr(Redll)  a  Pr(Blackll).  Since 
Pr(Redl)  ♦  PrCBlackI)  a  1  and  Pr(Redll)  ♦  Pr(Blackll)  a  1, 
these  Indifference  responses  further  laplv  that  Pr(Redl)  a 
Pr(Redll)  a  Pr(Blackl)  a  Pr(Blackll)  a  0.50.  A  paradox 
occurs  because  most  people  will  then  respond  to  questions 
(3)  and  (4)  with  Redll  and  Blackll,  respectively.  The 
response  of  Redll  in  question  (3)  implies  that  Pr(Redll)  > 
Pr(Redl),  from  which  it  logically  follows  that  Pr(Blackll) 
<  Pr(Blackl),  due  to  the  fact  that  Pr(Redl)  ♦  Pr(Blackl)  a 
1.  However,  this  is  contradicted  by  the  choice  of  Blackll 
in  question  (4),  which  implies  that  Pr(Blackll)  > 
Pr(Blackl).  This  pattern  of  responses  violates  the  first 
two  axioms  of  rationality  described  above. 
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From  th«  above  discussion.  It  appears  that  people 
prefer  to  bet  on  events  with  known  rather  than  unknown 
probabilities.  Such  betting  preferences  nay  depend  on  how 
probabilities  of  events  are  judged  under  anbigulty,  but 
they  nay  also  depend  on  an  aversion  to  ganbllng  under 
conditions  of  Ignorance.  For  research  purposes.  It  Is 
useful  to  enploy  a  technique  that  distinguishes  judgnents 
under  uncertainty  fron  avoidance  of  anbigulty  In  ganbllng 
scenarios.  In  the  present  study,  subjects  responded  by 
Indicating  their  degree  of  confidence  in  their  Judgnent 
that  one  event  Is  nore  likely  to  occur  than  is  another 
event.  Other  studies  have  examined  aspects  of  the  Ellsberg 
paradox  (Fellner,  1961;  Becker  &  Brownson,  1964;  Tates  & 
Zukowskl,  1976;  Elnhorn  A  Hogarth,  1985;  Einhorn  &  Hogarth, 
In  press).  In  these  studies,  however,  the  values  of 
outcomes  were  dependent  upon  subjects'  responses,  as 
opposed  to  the  present  study's  use  of  Independent  outcome 
values . 

Anbigulty  and  Probabl 1 1 ty  Terms 

One  can  describe  the  uncertainty  of  an  outcome  In  an 
ambiguous  fashion  by  defining  a  range  of  numerical 
probability  values  relating  to  the  event  in  question.  An 
alternative  approach  toward  ambiguity  can  be  found  In  the 
use  of  probability  words  or  phrases.  Probability  terms, 
such  as  1  lkel y.  doubtful,  good  chance,  etc.,  are  generally 
used  by  people  to  describe  uncertain  events. 

There  are  many  possible  reasons  that  people  frequently 
prefer  to  use  non-numerical  estimates  of  probabilities. 
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One  reason  suggested  by  Vallsten,  Budescu,  Rapoport,  Zwick, 
and  Forsyth  (in  press)  Is  that  people  prefer  to  express 
Imprecise  opinions  In  imprecise  terns,  such  as  probability 
phrases.  Secondly,  Zimmer  (1983)  held  that  mest  people 
deal  oore  effectively  with  verbal  than  with  numerical 
expressions  of  uncertainty.  Note  that  children  learn  how 
to  talk  long  before  they  learn  how  to  perform  arithmetic 
and  calculate  percentages.  Additionally,  Zimmer  noted  that 
a  mathematical  treatment  of  probability  was  net  conceived 
until  1660,  while  verbal  expressions  of  uncertainty  existed 
in  most  languages  for  a  long  time  before  that.  Another 
reason  for  the  common  use  of  verbal  expressions  of 
uncertainty  may  stem  from  people’s  desire  to  use  a  verbal 
rather  than  numerical  style  of  written  and  spoken 
communication.  There  are  many  real-world  events  for  which 
a  numerical  probability  estimate  would  seem  less 
appropriate  than  a  verbal  probability  expression.  For 
example,  it  seems  much  more  sensible  to  say  "it  was 
possible  but  not  likely",  rather  than  "there  was  a  10—15% 
chance”  with  reference  to  the  event  that  Shakespeare  was 
thinking  of  Ann  Hathaway  when  he  wrote  his  twelfth  sonnet. 

Beyth-Marom  (1982)  suggested  other  reasons  for  the  use 
of  non-numerlcal  probability  estimates.  First,  they 
prevent  one's  estimate  from  being  Judged.  Secondly,  they 
allow  one  to  avoid  making  explicit  derivations  to  defend 
the  estimate.  Thirdly,  many  people  believe  that  a 
probability  phrase  is  no  more  ambiguous  than  is  a  range  of 


numerical  probability  valuta.  Btoaust  most  people  use 
probability  phrases  to  express  degrees  of  uncertainty,  It 
Is  laportant  to  study  the  factors  that  affect  the  oeanlngs 
of  these  probability  teras. 

Measurement  of  Vagueness 

A  problea  with  studying  ambiguity  in  verbal  rather 
than  numerical  expressions  la  that  the  measurement  of 
ambiguity  is  not  as  straightforward.  It  involves  the 
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formulation  of  a  reasonable  means  of  transforming  verbal 
expressions  of  uncertainty  into  measurable  quantities. 
Although  it  will  not  be  necessary  to  actually  measure  the 
meanings  of  terms  used  in  this  study,  it  is  still 
appropriate  to  discuss  measurement  techniques  for  two 
reasons.  First,  prior  measurement  of  each  of  the  terms 
used  in  this  study  (except  for  the  term,  unspecified)  was 
required  to  determine  important  parts  of  the  experimental 
design.  Secondly,  the  present  research  may  provide 
knowledge  about  factors  that  should  be  considered  when 
measuring  the  meanings  of  vague  terms. 

One  approach  toward  the  measurement  of  the  meanings  of 
probability  words  involves  gathering  numerical  probability 
estimates  for  probability  phrases  from  a  large  number  of 
subjects.  From  these  data,  information  about  the  central 
probability  value  and  the  variability  in  probability  values 
for  each  term  can  be  determined.  This  technique  has  been 
used  often  in  previous  research  on  the  meanings  of 
probability  or  frequency  teras  (Simpson,  19*4,  1963.  Stone 
4  Johnson,  1959,  Llchstensteln  k  Newman,  1967;  Hakel,  1968; 


Beyth-Marom,  1982).  All  of  these  studies  found 
considerable  variability  over  subjects  in  the  assignment  of 
numbers  to  probability  phrases.  However*  the  probability 
phrases  did  have  fairly  consistent  numerical  meanings  to 
individual  subjects  over  time  (Beyth-Maroa,  1982).  A 
problem  with  this  technique  is  that  it  does  not  address  the 
issue  of  whether  the  probability  phrases,  themselves,  have 
vague  meanings  to  individuals,  or  whether  people  merely 
differ  in  their  inter pr etation  of  probability  values 
(Budescu  A  Wallsten,  1985). 

In  other  research,  it  has  been  suggested  that  the 
meaning  of  a  probability  term  can  be  represented  by  a 
membership  function  on  the  1 0 , 1 ]  interval  (Zadeh,  1978; 
Watson,  Weiss  A  Donnell,  1979).  A  membership  function 
indicates  the  degree  to  which  an  event,  object,  or  value 
"fits"  into  a  vague  description  or  category.  In  the  case 
of  probability  terms,  a  membership  function  would  show  how 
well  each  probability  value  is  described  by  a  particular 
term.  These  membership  functions  can  take  on  any  shape 
whatsoever,  but  continuous  single-peaked  or  monotonic 
functions  are  the  easiest  to  analyze  and  make  the  most 
sense  conceptually. 

The  specific  numerical  probability  value  (or  values) 
that  are  best  described  by  a  particular  phrase  would  take 
on  the  maximum  value  of  the  membership  function  (usually 
one).  Those  probability  values  that  are  not  at  all 
described  by  a  probability  phrase  would  take  on  the  minimum 
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value  of  the  function  (usually  tei- o).  Other  probabilities 
with  Intermediate  degrees  of  membership  In  the  concept 
represented  by  the  phrase  would  generally  take  on 
Intermediate  values  between  zero  and  one  In  this  function. 

Wallsten,  et  ml,  (In  press)  utilized  a  modified  pair- 
comparison  procedure  to  measure  the  vagueness  of 
probability  phrases.  In  this  procedure,  subjects  Judged 
pairs  of  probability  values  with  respect  to  how  much  better 
one  rather  than  the  other  was  described  by  each  of  various 
probability  terms.  If  the  properties  of  the  resulting  data 
satisfy  the  axioms  of  an  additive  difference  structure 
(Krantz,  Suppes,  Luce,  t  Tversky,  1971),  then  it  is 
legitimate  to  use  certain  scaling  procedures  to  derive  the 
membership  function  for  each  probability  term.  These 
scaling  techniques  allow  one  to  make  predictions  about 
subjects'  responses  In  the  pair-comparison  task.  It  was 
found  that  observed  and  predicted  responses  were  correlated 
in  the  range  of  0.75  to  0.77.  Independent  Judgments  in  a 
related  modified  palr-compari son  task  were  also  found  to  be 
predicted  by  the  responses  on  the  first  task.  Further, 
responses  were  found  to  be  consistent  for  subjects  over 

time  (average  correlation  of  0.88  between  sessions).  The 

! 

shapes  and  locations  of  the  membership  functions  gathered 
in  that  study  revealed  large  Individual  differences, 
however . 

Factors  Affecting  the  Meanings  of  Probability  Terms 

Environmental  factors  may  play  a  large  role  In 


people's  Inter pretatlons  of  probability  phrases.  The 


research  problem  could  be  expressed  In  terms  of  determining 
the  individual  difference  and  context  factors  that  affect 
the  judged  meanings  of  probability  terms,  regardless  of  the 
way  in  which  the  meanings  are  derived.  Factors  that  might 
affect  the  meaning  of  a  probability  phrase  to  an  individual 
include,  among  other  things:  (1)  the  reliability  of  the 
information  source(s);  (2)  the  number  of  sources  of 
information;  (3)  the  number  of  words  'in  one's  vocabulary  of 
probability  phrases;  (4)  general  semantic  context;  (5)  the 
Importance  of  the  event  being  analyzed;  (6)  the  base  rata 
of  occurrence  of  the  event.  The  effects  of  some  of  these 
context  factors  on  probability  or  frequency  phrases  have 
been  the  focus  of  previous  research  (Pepper  &  Prytulak, 

1974;  Beyth-Marom,  1982;  Wallsten,  Fillenbaum  &  Cox, 

1986) . 

This  study  is  primarily  concerned  with  a  specific 
context  effect  —  the  desirability  of  the  outcomes  of  the 
event  being  analyzed  by  the  decision-tnaker.  Desirability 
is  somewhat  related  to  the  importance  of  the  event, 
although  outcomes  can  have  differing  desirabilities  while 
importance  is  held  constant.  It  seems  reasonable  to  assume 
that  a  continuum  of  desirability  exists  at  each  level  of 
Importance  of  events.  For  example,  both  flunking  a  test 
and  nuclear  war  could  be  rated  by  a  subject  as  highly 
undesirable,  but  certainly  the  latter  event  is  more 
important.  Importance  was  held  constant  in  this  study, 
while  desirability  was  manipulated  by  the  winning  or  losing 
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of  points  on  «ach  trial. 

Outcome  Desirability 

The  effects  of  outcoae  desirability  on  subjective 
probabilities  under  conditions  of  risk  have  been  studied  in 
depth  (Marks,  1951;  Scheibe,  1964;  Morlock  &  Hertz,  1964; 
Pruitt  i  Hoge,  1965;  Irwin  &  Snodgrass,  1966;  Irwin  & 
Metzger,  1966;  Slovic,  1966;  Irwin  &  Graee,  1968).  In 
these  studies,  subjects'  choices  or  estimates  of  the 
likelihoods  of  events  were  positively  related  to  the 
Independent  values  of  the  events.  The  Independent  outcoae 
values  (IOs)  are  to  be  distinguished  frou  the  dependent 
outcome  values  (DOs),  which  depend  on  the  accuracy  of  the 
person's  prediction. 

Irwin  &  Snodgrass  (1966)  gauged  subjective 
probabilities  by  means  of  a  betting  procedure,  in  which  the 
frequency  of  subjects'  positive  bets  was  the  dependent 
variable.  Subjects  made  bets  within  a  prescribed  range  on 
whether  or  not  a  marked  card  would  be  drawn  from  a  deck 
with  a  known  number  of  marked  and  unmarked  cards.  In 
addition  to  winning  or  losing  the  bet,  subjects  won  or  lost 
money  if  a  marked  card  was  drawn,  regardless  of  their 
prediction.  The  bet  thus  determined  the  DO  and  the 
additional  winnings  or  losses  attributable  to  the  drawing 
of  a  marked  card  became  the  10.  It  was  found  that  positive 
IOs  led  to  a  higher  frequency  of  positive  bets  than  did 
negative  IOs.  Further,  this  effect  was  strongest  for 
objective  probabilities  (proportions  of  marked  cards) 
closest  to  0.50.  In  a  related  study,  Irwin  and  Metzger 


(1966)  found  that  Mi*  positive  relationship  between  10  and 
estimated  likelihood  was  maintained  even  when  10  was 
probabi  listle.  In  this  study*  the  IOs  had  well-defined 
positive  or  negative  expected  values,  but  on  any  given 
trial  subjects  did  not  know  with  certainty  whether  they 
would  win  or  lose  money  for  drawing  a  marked  card. 

A  slightly  different  paradigm  was  utilized  by  Slovlc 
(1966)  to  test  the  effect  of  desirability  on  judged 
likelihood.  In  his  study,  subjects  gave  direct  numerical 
estimates  of  subjective  probabilities  under  conditions  of 
varying  10.  Again,  it  was  found  that  estimated  likelihoods 
of  events  were  positively  related  to  desirabi lities  of  IOs. 
Slovlc  termed  this  effect  "partial  optimism”  because  it 
related  only  to  the  sign  of  the  10,  not  to  its  magnitude. 
Also,  Irwin  A  Graee  (1963)  were  unable  to  find  a  consistent 
significant  relationship  between  10  and  choice 
probabilities  for  paired  events  when  the  IOs  for  the  two 
events  under  consideration  had  the  same  sign,  but  different 
magnitudes.  There  was,  however,  a  significant  effect  of  10 
magnitude  at  some  levels  of  objective  probability. 

Crandall,  Solomon,  A  Kellaway  (1955)  found  a  significant 
overall  interaction  between  10  and  choice  probabilities 
when  both  IOs  had  the  same  sign.  When  this  effect  was 
analyzed  at  each  level  of  objective  probability,  however, 
it  was  not  significant. 

In  all  cases  described  above,  the  events  for  which 
subjects  estimated  probabilities  were  precisely  defined. 
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That  ls(  tha  information  on  which  subjects  based  their 
subjective  probabilities  was  either  full  knowledge  of  the 
probability  distribution  of  events  or  sample  information 
relating  to  a  specific  probability  distribution  of  events. 
Thus*  subjects  were  responding  under  conditions  of  risk*  as 
described  by  Ellsberg.  If  subjects  had  had  only  vague  or 
ambiguous  information  on  the  distribution  of  outcomes*  or 
perhaps  no  information  at  all  (creating  an  Ellsberg  paradox 
situation),  their  subjective  probabilities  might  have  been 
affected  differently  by  10  deslrabi 1 lty. 

Purpose  and  Hypotheses 

The  main  purpose  of  this  experiment  was  to  examine  the 
effect  of  Independent  outcome  desirability  on  Judgments 
made  under  conditions  of  ambiguity  and  ignorance*  as 
represented  by  verbal  expressions.  A  secondary  goal  of  the 
experiment  was  to  determine  if  different  probability 
phrases  show  different  effects  due  to  10  desirability. 

On  every  trial,  subjects  were  given  information  about 
the  likelihood  of  occurrence  of  two  outcomes.  Each  outcome 
had  a  certain  10  associated  with  it.  For  one  outcome, 
subjects  were  given  objective  probability  information,  and 
for  the  other  outcome,  they  were  provided  either  ambiguous 
information  (a  probability  term)  or  no  Information  at  all. 
The  latter  case  represented  a  condition  similar  to  the 
Ellsberg  paradox.  Subjects  then  indicated  their  degree  of 
confidence  that  one  outcome  was  more  likely  to  occur  than 
the  other  outcome.  It  was  hypothesized  that  subjects' 


responses  in  this  experiment  would  be  positively  biased 
toward  the  outcome  with  the  relatively  favorable 
desirability  factor.  Further,  this  bias  should  be 
strongest  in  cases  where  an  objective  probability  of  0.50 
was  matched  with  the  probability  terms,  tossup  and 
unspecified  (the  Ellsberg  paradox  condition),  according  to 
the  results  of  Irwin  &  Snodgrass  (1966).  Thus,  when  the 
objective  probability  of  0.50  has  associated  with  it  a 
negative  desirability  and  the  probability  phrase, 
unspecified,  has  associated  with  it  a  positive 
desirabi 1 ity,  the  verbal  expression  should  be  interpreted 
with  a  subjective  value  greater  than  that  accorded  the 
objective  probability.  This  would  be  a  contradiction  of 
El  1 sberg's  contention  that  people's  intuition  usually  leads 
them  to  accord  a  higher  subjective  value  to  an  objective 
probability  of  0.50  (risk)  than  to  an  event  for  which 
people  were  completely  Ignorant  of  probabilities.  This 
bias  due  to  desirability  could  be  construed  as:  (1)  a 
change  in  the  Judged  meaning  of  a  given  probability  phrase 
(perhaps  a  change  in  the  shape  or  location  of  the 
membership  function  for  that  phrase),  (2)  a  change  in  the 
subjective  value  accorded  the  objective  value  of  0.50,  (3) 
a  type  of  ambiguity  aversion,  or  (4)  some  combination  of 
the  above. 

In  this  experiment,  one  could  have  asked  subjects  to 
bet  on  either  the  risky  event  or  on  the  event  with  the 
vaguely  specified  probability,  while  manipulating  the 
desirability  factor.  The  drawback  to  that  design,  however. 


is  that  any  effects  due  to  desirability  sight  be  confounded 
with  subjects'  desire  to  avoid  aabiguity  in  a  gambling 
scenario.  The  present  design  controls  for  this  factor  by 
asking  subjects  to  give  their  best  judgaents  of  the 
relative  likelihoods  of  the  two  paired  events,  the 
consequences  of  which  are  Independent  of  their  Judgaents. 

Method 


Subjects 

Twenty  graduate  students  recruited  with  notices 
distributed  in  the  social  science  departments,  the  Business 
School,  and  the  School  of  Journalism  at  the  University  of 
North  Carolina  at  Chapel  Hill  served  as  paid  subjects.  At 
the  end  of  the  experiment,  a  cash  bonus  of  $10  was  paid  to 
those  ten  people  whose  point  totals  were  the  highest. 
Procedure 

Subjects  performed  the  experiment  individually  while 
seated  in  a  small  cubicle.  Stimuli  were  presented  on  the 
color  monitor  of  an  IBM  PC,  and  responses  were  made  by 
means  of  a  joystick  connected  to  the  computer. 

The  computer  screen  was,  in  effect,  split  in  half  from 
top  to  bottom.  One  side  of  the  screen  showed  a  probability 
spinner  with  a  radial  portion  of  the  spinner  colored  white 
and  the  remainder  colored  red.  Subjects  were  informed  that 
the  displayed  proportion  of  white  in  the  spinner 
represented  the  true  probability  of  that  spinner's  landing 
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On  the  other  side  of  the  screen,  subjects  received 
inforaation  relating  to  the  likelihood  of  another  spinner's 
landing  en  white,  but  were  not  able  to  actually  view  this 
other  spinner.  Instead,  they  saw  one  of  six  phrases. 

There  were  five  probability  teras  (doubtfu 1 .  improbable. 
tossup,  likely,  or  good  chance)  which  were  each  followed  by 
the  phrase,  "...  to  land  on  white."  These  phrases 
described  the  likelihood  of  that  spinner's  landing  on 
white.  (Hereafter,  this  will  be  referred  to  as  the 
invisible  spinner.)  In  one  condition,  subjects  saw  the 
phrase,  "Unspecified  to  land  on  white,"  which  they 
understood  to  mean  that  absolutely  no  inforaation  was 
available  about  the  invisible  spinner.  Except  for  the  case 
Involving  the  word,  unspecified,  the  actual  probability 
distribution  that  governed  the  likelihood  of  an  invisible 

spinner's  landing  on  white  was  represented  by  a  single 

probability  value  that  was  based  on  previous  research  on 
the  measurement  of  the  meanings  of  probability  terms 
(Vallsten,  et  al,  in  press).  The  probability  terms  used  in 
this  experiment  were  assigned  probability  values  as 
follows:  doubtfu 1 :  0.18;  lmprobabl e:  0.32;  tossup : 

0.50;  good  chance :  0.64;  and  likely:  0.78.  Unspecified 

was  assigned  a  probability  value  of  0  50,  based  on  the 
reasonable  assumption  that  complete  Ignorance  of 
probability  Information  should  lead  one  to  assume  an 
attitude  of  indifference  between  any  two  mutually  exclusive 
and  exhaustive  outcomes. 

On  a  single  trial,  a  probability  spinner  appeared  on  a 


randomly  selected  aids  of  the  acr««n,  and  one  of  the  six 
phraaea  appeared  on  the  other  aide.  The  proportion  of 
white  In  the  vlalble  aplnner  waa  varied  among  four  values 
uniquely  predetermined  for  each  of  the  six  phrases  with 
which  it  was  matched.  The  phrases  "likely  to  land  on 
white"  and  "good  chance  to  land  on  white"  were  matched  with 
visible  spinners  that  had  proportions  of  white  of  0.45, 
0.62,  0.79,  and  0.95.  Phrases  "doubtful  to  land  on  white" 
and  "lmprobab 1 e  to  land  on  white"  were  matched  with  visible 
spinners  that  had  proportions  of  white  of  0.05,  0.22,  0.39, 
and  0.55.  The  phrases  "tossup  to  land  on  white"  and 
"unspecified  to  land  on  white"  were  matched  with  visible 
spinners  with  proportions  of  white  of  0.30,  0.50,  0.50, 
and  0.70. 

To  Incorporate  the  concept  of  outcome  desirability  In 
the  experiment,  each  spinner's  landing  on  white  had 
associated  with  it  an  Independent  point  value.  These 
values  were  either  +500,  -500,  or  0  points.  In  all  cases, 
the  value  of  a  spinner's  landing  on  red  was  0  points. 

There  were  three  different  conditions  of  desirability 
presented.  One  condition  involved  a  desirability  factor  of 
♦500  points  associated  with  the  visible  spinner  and  -500 
points  associated  with  the  probability  phrase.  In  the 
second  condition  the  signs  of  these  desirability  factors 
were  reversed.  The  third  condition  had  desirability 
factors  of  0  points  associated  with  both  the  visible 
spinner  and  the  probability  phrase. 


At  the  end  of  the  experiment,  subjects  answered  a  few 
questions  concerning  their  response  strategies  and  their 
understand! ng  of  the  instructions.  This  manipulation  check 
consisted  of  a  brief  written  multiple  choice  questionnaire. 

The  sequence  of  events  on  a  single  trial  was  as 
follows : 

1.  A  randomly  selected  screen  was  displayed  to  the 
subject.  On  one  side  of  the  screen  was  a  spinner  and  the 
desirability  value  associated  with  that  spinner's  landing 
on  white.  On  the  other  side  of  the  screen  was  one  of  the 
six  probability  phrases  referring  to  the  likelihood  of  an 
invisible  spinner's  landing  on  white  and  the  desirability 
value  associated  with  that  spinner's  landing  on  white. 
Traversing  the  width  of  the  screen  at  the  bottom  was  a  line 
segment  with  an  arrow  positioned  in  the  middle. 

2.  The  subject  indicated  which  spinner  (visible  or 
invisible)  he  or  she  judged  to  be  more  likely  to  land  on 
white  by  using  a  Joystick  to  position  the  arrow  along  the 
line  segment.  Moving  the  arrow  toward  one  or  the  other  end 
of  the  line  segment  indicated  stronger  confidence  in  the 
Judgment  that  the  spinner  on  that  side  of  the  screen  would 
land  on  white.  The  arrow  could  be  positioned  at  any  one  of 
200  points  along  the  line  segment,  but  there  were  only 
three  hash  marks  visible  to  the  sub Ject — one  at  each  end 
and  one  in  the  middle  of  the  line  segment. 

3.  After  the  arrow  was  positioned,  the  subject  pushed 
a  button  on  the  Joystick  assembly  that  caused  the  spinners 
to  "spin".  The  subject  did  not  actually  see  the  spinners 


2 


spinning  ind  was  not  told  tho  outcome  (white  or  red)  of  an 
individual  spinner.  However,  a  noise  effect  simulated 
spinning  while  the  word  "spinning"  appeared  at  the  top  of 
each  side  of  the  screen.  The  outcome  of  each  spinner  was 
based  on  the  probability  distributions  described  above. 

4.  Zf  either  or  both  spinners  landed  on  white,  the 
correspond! ng  desirability  values  were  added  to  or 
subtracted  from  the  subject's  cumulative  total  of  points. 
This  total  was  displayed  and  updated  on  every  trial  in  a 
window  near  the  top  of  the  screen. 

5.  The  subject  pushed  a  button  on  the  Joystick 
assembly  to  initiate  the  next  trial. 

Design 

There  were  six  probability  phrases  matched  with  four 
different  probability  spinners  each.  Also,  each  spinner- 
phrase  pair  had  associated  with  it  one  of  three  conditions 
of  desirability.  This  created  a  total  of  72  trials  which 
constituted  a  block.  Subjects  performed  one  block  of 
trials  in  random  order  on  each  of  two  days.  Sessions  were 
separated  by  24  to  48  hours.  There  was  no  practice,  but 
subjects  read  detailed  instructions  while  viewing  the  first 
randomly  selected  screen  of  their  session. 

Results 

Reliability 

The  first  step  was  to  assess  the  reliability  of  the 
data  by  calculating  the  linear  correlation  between  each 
subject's  responses  over  the  two  sessions.  Table  1  shows 
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both  a  simple  Pearson  correlation  of  each  subject's 
responses  on  the  two  days,  as  well  as  a  pooled  correlation. 
Pooling  was  achieved  by  standardizing  the  responses  so  tnat 
they  had  a  mean  of  zero  for  each  of  the  six  probability 
phrases.  As  can  be  seen  in  the  table,  this  adjustment  did 
not  significantly  change  the  correlations.  The  mean 

correlation  over  all  subjects  between  responses  for  session 

« 

one  and  session  two  was  0.61  for  both  the  simple  and  pooled 
cases.  The  simple  correlations  were  above  0.80  for  four 
subjects  and  above  0.70  for  ten  subjects. 

Analyses  on  Individual  Phrases 

The  three  main  factors  in  the  experimental  design  for 
each  of  the  six  probability  phrases  were  (a)  the 
probability  of  the  visible  spinner  landing  on  white  (four 
levels),  (b)  the  outcome  desirability  combination  (three 
levels),  and  (c)  session  (two  levels).  Figure  1  shows 
mean  responses  for  each  phrase  as  a  function  of 
probability,  ignoring  desirability  level.  Responses  are 
scaled  so  that  0  means  certain  that  the  invisible  spinner 
is  more  likely  to  land  on  white,  200  means  certain  that  the 
visible  spinner  is  more  likely  to  land  on  white,  and 
intermediate  values  designate  intermediate  degrees  of 
certainty.  As  expected,  responses  increase  with  visible 
spinner  probability.  Hean  responses  at  each  desirability 
condition  for  each  phrase,  ignoring  probability  level,  are 
shown  as  the  first  six  rows  of  Table  2. 

The  main  analyses  sought  to  determine  the  effect,  if 
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any,  of  the  desirability  values  on  subjects'  responses. 

The  initial  analyses  involved  six  distinct  4x3x2 
(Probability  x  Desirability  x  Session)  repeated  measures 
ANOVAs,  one  for  each  probability  phrase.  The  ANOVAs  were 
performed  in  the  manner  recommended  by  Winer  (1971).  la 
which  the  error  term  for  each  effect  was  the  Interaction  of 
that  effect  with  the  factor  of  subjects. 

Subjects'  responses,  scaled  such  that  a  higher  value 
of  the  response  indicated  a  stronger  confidence  that  the 
visible  spinner  would  land  on  white,  was  the  dependent 
variable.  It  was  hypothesized  that  mean  responses  would 
Increase  as  the  level  of  spinner  probability  Increased,  as 
they  do  (see  Figure  1).  No  other  response  pattern  would  be 
appropriate  if  the  subjects  believed  that  the  spinners  were 
fair.  The  main  hypothesis  of  the  experiment,  however,  was 
that  mean  response  values  would  be  lowest  for  the  negative 
splnner/poslt 1 ve  phrase  desirabilities,  and  greatest  for 
the  positive  spinner/negative  phrase  deslr abl 1 1 tl es. 

The  results  of  these  analyses  are  shown  in  Table  3. 
Session  was  not  a  significant  factor  for  any  of  the  six 
probability  phrases.  As  expected,  the  probability  of  the 
visible  spinner  landing  on  white  was  significant  in  the 
appropriate  direction  for  all  six  probability  phrases. 

From  Tables  2  and  3.  it  can  be  seen  that  level  of 
desirability  was  significant  in  the  hypothesized  direction 
for  the  probability  phrases,  doubt fu 1 .  good  chance,  and 
likely.  It  was  significant,  but  with  somewhat  unexpected 
mean  response  values,  for  the  probability  phrase. 
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Improbable.  Desirability  was  not  significant,  but  had  mean 
response  values  in  the  hypothesized  direction  for  the 
probability  phrases,  tossup  and  unspecified. 

Analyses  on  Phrase  Pairs 

In  order  to  Increase  power,  the  phrases  were  combined 
into  three  pairs— high  probability  (good  chance  and 
likely),  middle  probability  (tossup  and  unspecified ) ,  and 
low  probability  (doubt fu 1  and  Improbable) — and  a  2  x  4  x  3 
(Phrase  x  Probability  x  Desirability)  ANOVA  was  performed 
on  each  pair.  There  was  no  hypothesized  pattern  of  mean 
responses  for  the  probability  phrase  factor,  so  it  was  not 
expected  to  be  significant.  The  mean  responses  for  each 
phrase  pair  at  each  level  of  desirabl 1 1 ty,  ignoring 
probability  level,  are  shown  as  the  last  three  rows  of 
Table  2.  Mean  responses  for  each  phrase  pair  as  a  function 
of  probability,  ignoring  desirability  level,  are  plotted  in 
Figure  2. 

The  results  of  these  ANOVAs,  shown  in  Table  4,  reveal 
that  probability  phrase  was  not  significant  in  any  of  the 
three  ANOVAs,  while  the  probability  of  the  visible  spinner 
landing  on  white  was  significant  in  the  hypothesized 
direction  in  every  case.  Desirability  was  significant  with 
the  predicted  response  pattern  for  both  the  high  and  the 
low  probability  phrases,  but  not  for  the  middle  probability 
phrases.  The  interaction  of  probability  with  desirability 
was  not  significant  in  any  of  these  analyses. 

As  can  be  seen  in  Figures  1  and  2,  the  probability 
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factor  had  a  generally  large  effect.  In  contrast,  however, 
when  the  10  desirability  factor  was  significant,  the  effect 
was  rather  small,  as  shown  in  Table  2.  In  general,  the  | 

high  probability  terms,  good  chance  and  llkel y,  showed  much 

| 

larger  effects  of  both  desirability  and  objective 

I 

probability  than  did  the  low  probability  terms,  doubtful 

| 

and  improbable.  The  middle  probability  terms  obviously  j 

showed  small  effects  of  desirability.,  since  they  were  non¬ 
significant,  but  showed  rather  large  effects  of  objective 
probability. 

The  El lsberg  Paradox 

Ellsberg  (1961)  claimed  that  people  commonly  violate  a 
fundamental  axiom  of  rationality  by  preferring  to  bet  on 
outcomes  stated  under  conditions  of  risk  rather  than  on 

! 
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outcomes  stated  under  conditions  of  Ignorance  or  high 

i 

I 

levels  of  ambiguity,  even  though  the  best  estimate  of  the 
probabilities  of  all  the  outcomes  under  consideration  was 
0.50.  This  finding,  known  as  the  Ellsberg  paradox,  would 
be  obtained  in  the  present  study  If  subjects  accorded  a 
higher  subjective  probability  to  the  objective  probability 
of  0.50  than  to  the  phrases,  tossup  and  unspecified,  or  in 
other  words  if  subjects  gave  mean  responses  si gni f leant  1 y 
above  the  neutral  response  of  100  when  these  two  phrases 
were  each  matched  with  a  visible  spinner  with  a  0.50 
probability  of  landing  on  white.  In  contrast,  a  major 
hypothesis  of  this  study  was  that  independent  outcome 

t 

desirability  biases  the  subjective  probability  toward  the 
outcome  with  the  relatively  favorable  desirability,  thereby 


overwhelming  any  effects  due  to  aoblguity  avoidance. 

Simple  t  tests,  comparing  the  appropriate  mean  responses  to 
100,  are  suitable  for  testing  this  hypothesis.  The  results 
of  this  analysis,  shown  in  Table  5,  reveal  that  only  with 
the  phrase,  tossup,  under  negative  spinner/positive  phrase 
desirability,  was  the  mean  response  significantly  below 
100.  Thus,  in  this  Instance,  10  desirability  appeared  to 
produce  a  bias  toward  the  outcome  with  the  relatively 
favorable  desirability  and  the  results  predicted  from  the 
Ellsberg  pa* * Jox  failed  to  hold.  Notably,  however,  in  no 
case  were  the  results  expected  on  the  basis  of  those  from 
Ellsberg  obtained  at  a  significant  level. 

Analysis  of  the  Questionnaire  Data 

The  results  of  the  questionnaire  given  to  subjects  at 
the  end  of  the  experiment  showed  that  eighteen  out  of 
twenty  subjects  understood  that  the  spinners  were  fair  and 
that  their  responses  had  no  effect  on  the  probability  of 
either  the  visible  or  invisible  spinner  landing  on  white. 
Six  questions,  phrased  like  the  first  one  in  the  Appendix, 
but  with  a  slightly  different  situation  in  each  case,  were 
used  to  assess  subjects'  understanding  of  this  point.  Four 
questions,  phrased  like  the  second  one  in  the  Appendix, 
revealed  that  nine  subjects  out  of  the  twenty  thought  that 
their  responses  had  some  effect  on  whether  or  not  they  won 
points.  Additionally,  a  final  question,  which  was 
identical  to  the  third  question  in  the  Appendix,  verified 
subjects'  understanding  of  the  two  main  ideas  of  the 
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Instructions,  and  explicitly  asked  subjects  to  explain 
their  response  strategy  when  presented  with  the  probability 
tern,  unspecified. 

Given  the  above  results,  it  was  decided  to  perfora 
separate  analyses  on  the  eleven  subjects  who  seemed  to 
understand  the  instructions  perfectly  and  on  the  nine  who 
seemed  not  to.  The  2  x  *  x  3  ANOVAs,  as  described  above 
for  the  three  pairs  of  probability  phrases,  were  performed 
separately  for  the  two  groups  of  subjects,  for  a  total  of 
six  analyses,  with  results  shown  in  Table  6. 

Probability  phrase  was  significant  only  for  the  phrase 
pair,  tossup  and  unspecified,  for  those  who  understood  the 
instructions,  while  the  probability  of  the  visible  spinner 
landing  on  white  was  significant  in  the  predicted  direction 
in  every  case.  Desirability  was  significant  in  the 
hypothesized  direction  for  the  high  probability  phrase 
pair,  g°od  chance  and  likely,  for  both  groups  of  subjects. 

For  the  low  probability  phrase  pair,  doubtful  and 
Improbable,  desirability  was  significant  in  an 
Inappropriate  pattern  for  those  subjects  who  did  not 
understand  the  Instructions,  and  was  not  significant,  but 
in  the  hypothesized  direction  for  those  subjects  who  did 
understand.  Desirability  was  not  significant  for  either 
group  of  subjects  for  the  middle  probability  phrase  pair, 
tossup  and  unspecified.  The  subjects  who  did  not 
understand  the  instructions  had  mean  responses  in  the 
appropriate  pattern,  however,  while  those  subjects  who  did 
understand  the  instructions  had  an  inappropr late  pattern  of 
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mean  responses.  The  interaction  of  probability  and 
desirability  was  not  significant  in  any  of  these  cases. 
Reanalyses  on  Most  Reliable  Subjects 

Analyses,  similar  to  the  ones  described  above*  were 
performed  on  the  ten  subjects  with  between  session 
correlations  of  responses  at  or  above  the  median  level  of 
0.70.  Individual  phrase  analyses  showed  that*  for  every 
phrase,  the  probability  of  the  visible  spinner  landing  on 
white  was  significant  in  the  hypothesized  direction. 
However,  only  for  the  phrase,  likely,  was  the  spinner 
desirability  effect  significant,  and  this  effect  was  not 
precisely  in  the  hypothesized  direction.  No  other  effects 
or  interactions  were  significant. 

For  the  analyses  on  phrase  pairs,  the  probability  of 
the  visible  spinner  landing  on  white  was  significant  in  the 
hypothesized  direction  in  every  case.  For  the  low 
probability  phrases,  spinner  desirability  was  significant 
in  the  hypothesized  direction,  while  for  the  high 
probability  phrases,  it  was  significant,  but  not  exactly  in 
the  hypothesized  pattern.  Spinner  desirability  was  not 
significant  for  the  middle  probability  phrases.  In  short, 
these  analyses  did  not  produce  any  better  results  than  had 
been  obtained  previously  on  all  twenty  subjects. 

Discussion 

In  general,  the  results  show  that  10  desirability 
affects  Judgments  of  relative  probability  when  the 
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uncertainty  is  represented  by  verbal  expressions.  The 
probability  phrases,  doubtful .  good  chance,  and  likely, 
showed  this  effect  clearly  when  analyzed  separately.  The 
phrase.  Inprobable,  was  also  significantly  affected  by 
desirability,  but  did  not  show  precisely  the  hypothesized 
pattern  of  responses.  The  middle  phrases,  tossup  and 
unspecified,  showed  the  expected  pattern  of  nean  responses, 
but  the  results  were  not  statistically  significant. 

The  results  of  the  analyses  on  pairs  of  phrases  showed 
that  desirability  was  significant  in  the  hypothesized 
direction  for  the  high  pair,  good  chance  and  likely,  as 
expected.  The  increased  power  of  this  analysis  also 
produced  a  significant  desirability  effect  in  the 
appropriate  direction  for  the  low  pair,  doubtful  and 
improbable.  The  middle  pair,  tossup  and  unspecified,  still 
failed  to  achieve  significance  for  the  desirability  effect, 
although  the  pattern  of  responses  was  in  the  hypothesized 
d irectlon . 

Differential  Effects 

The  results  of  this  experiment  Indicate  a  clear 
difference  in  the  effects  of  desirability  on  the  low, 
middle,  and  high  probability  phrases.  Any  explanation  of 
the  overall  effect  of  desirability  on  judgments  undar 
ambiguity  and  Ignorance  must  take  this  finding  Into 
account. 

)  Judged  meanings  of  phrases.  The  low  phrases, 

doubtful  and  improbable,  showed  smaller  effects  of  both 
objective  probability  and  desirability  than  did  the  high 
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phrases,  good  chance  and  1 ikel  y.  Other  research  (Wallsten, 
Fillenbaum,  A  Cox,  1986)  has  also  shown  that  low 
probability  phrases  are  less  affected  by  context  than  are 
neutral  and  high  probability  phrases.  Context  In  that  case 
referred  to  the  base  rate  of  occurrence  of  events.  A 
possible  reason  that  context  has  less  effect  on  low  than  on 
high  phrases  might  be  that  the  meanings  of  low  phrases  are 
further  from  the  center  of  the  probability  interval  than 
are  the  meanings  of  high  phrases.  This  would  give  the 
meanings  of  high  probability  phrases  more  freedom  to 
undergo  shifts  when  Influenced  by  factors  such  as 
desirability  or  objective  probability  value. 

)  The  data  from  this  experiment  are  not  suitable  for 

precisely  determining  the  best  Judged  meanings  of  the 
phrases.  By  examining  the  data  for  each  subject  averaged 
over  all  levels  of  desirability,  however,  one  can  note  at 
what  approximate  point  the  phrase  and  probability  were 
judged  equal  (i.e.  where  the  mean  response  was  100).  Out 
of  40  such  determinations  for  the  low  terms,  26  were 
located  below  the  probability  value  of  0.22.  Eleven  of 
these  26  determinations  were  for  doubtfu 1  and  the  remaining 
15  were  for  Improbable.  In  contrast,  the  high  terms  had 
only  3  out  of  40  determinations  above  the  probability  value 
of  0.79,  all  three  occurring  for  the  phrase,  good  chance. 
This  indicates  that  the  best  Judged  meanings  for  high 
)  probability  phrases  are  less  extreme,  on  average,  than  they 

are  for  low  probability  phrases. 
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Precision  of  aeaning.  A  reason  for  the  lack  of 
significant  results  for  the  alddle  probability  teras  aay 
stea  froa  the  relative  precision  of  their  aeanlngs.  Tossup 
was  the  aost  speolfic  of  all  the  teras  used  in  this  study, 
with  a  relatively  precise  aeaning  of  0.50.  In  contrast, 
unspecified  would  seea  to  be  the  least  specific  of  all  the 
teras  used  In  this  experlaent.  However,  the  results  of  the 
questionnaire  (see  Appendix,  question  3)  indicated  that 
unspecified  was  also  treated  as  having  a  relatively  precise 
aeaning  of  0.50  probability.  Thirteen  of  the  twenty 
subjects  explicitly  aentloned  the  0.50  probability  In  the 
visible  spinner  as  the  cutoff  point  for  deciding  whether 
the  visible  or  the  Invisible  spinner  was  aore  likely  to 
land  on  white.  The  aeanlngs  of  both  tossup  and  unspecified 
aay  therefore  have  been  aore  iapervlous  to  the  effects  of 
Independent  outcoae  desirability  than  the  aeanlngs  of  the 
other  phrases  used  In  this  study,  resulting  In  the  saall, 
non-slgnlflcant  results  reported  here. 

Unfortunately,  the  above  result  and  Interpretation 
also  laply  that  the  phrase,  unspecified,  aay  not  truly 
represent  Ellsberg's  condition  of  "coaplete  ignorance”.  It 
aay  be  aore  closely  related  to  a  condition  of  aablgulty. 

Shifts  In  sub jectl ve  value.  Previous  research  (Irwin 
A  Graee,  1968;  Morlock  A  Hertz,  1964;  Crandall,  Soloaon,  A 
Kellaway,  1955)  showed  that  10  desirability  caused  a 
significant  shift  In  the  subjective  values  accorded  to 
objective  probabilities,  with  the  largest  shifts  found  near 
the  alddle  of  the  probability  range.  In  the  present  study. 
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however,  this  pattern  of  results  did  not  occur.  Note  that 
It  cannot  be  determined  whether  the  significant  effects  of 
desirability  found  at  the  low  and  high  ends  of  the 
contlnuua  are  due  to  shifts  in  the  subjective  values 
accorded  the  visible  probabi 1 1 ti es  or  to  changes  in  the 
meanings  of  the  phrases.  -However,  the  lack  of  any 
significant  effects  due  to  desirability  in  the  middle  range 
of  probability  would  seem  to  indicate  that  only  very  small 
shifts,  if  any,  occurred  in  the  subjective  probability 
accorded  to  the  visible  spinner  in  that  range. 

That  the  shifts  in  subjective  value  accorded  the 
visible  spinner  probability  were  not  significant  (for  the 
middle  range  of  probability,  at  least)  may  relate  to  the 
fact  that  this  experiment  is  fundamentally  different  from 
the  earlier  studies  of  Independent  outcome  desirability. 

That  is,  subjects  were  never  before  required  to  compare  the 
relative  likelihoods  of  probabilities  and  probability 
phrases.  The  task  of  making  this  type  of  comparison  may 
Interact  with  desirability  or  produce  effects  that  add  to 
those  of  deslrabi llty.  One  such  effect,  discussed  further 
below,  is  ambiguity  aversion.  For  example,  since  there  is 
some  evidence  that  the  middle  probability  phrases  were  the 
most  precise  in  meaning,  and  thus  the  least  ambiguous,  it 
should  not  be  surprising  if  ambiguity  aversion  effects  were 
smallest  for  these  terms. 

Asymmetry  of  effects.  One  interesting  facet  relating 
to  this  interpretation  of  the  results  is  that  the  10 
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deslrabl 1 lty  effect  was  generally  not  symmetric.  That  la, 
for  four  of  the  six  phraaea  (all  except  doubtful  and 
unspecified),  the  effect  uas  greater  for  negative 
aplnner/posi tl ve  phrase  desirability  than  it  was  for  the 
opposite  type  of  desirability.  This  implies  that  either 
the  Judged  meaning  of  the  phrase  Increased  more,  or  that 
the  subjective  value  accorded  the  objective  probability 
decreased  more  for  this  condition  than  for  the  opposite 
one.  One  Interpretation  of  this  result  Is  that  people 
normally  have  a  bias  against  ambiguity,  and  towards  firm 
probabilities,  as  previous  research  has  shown  (Ellsberg, 
1961;  Becker  &  Brownson,  1964;  Tates  A  Zukowskl,  1976; 
Einhorn  &  Hogarth,  1986).  Further  evidence  for  this  point 
Is  given  in  Table  2,  where  the  mean  responses  at  xero 
desirability  are  all  greater  than  100,  indicating  an 
avoidance  of  ambiguity.  Therefore,  attempts  to  make  the 
ambiguity-avoidance  bias  stronger  will  show  fairly  small 
effects.  In  contrast,  attempts  to  Induce  the  opposite  type 
of  bias  may  show  larger  effects. 

Membership  functions.  Another  explanation  for  the 
results  of  this  experiment  Incorporates  the  concept  of 
membership  functions.  There  are  two  commonly  encountered 
shapes  of  membership  functions  for  probability  terms:  (a) 
single-peaked,  and  (b)  monotonic  (Vallsten,  et  al,  in 
press;  Rapoport,  et  al,  in  press).  Figure  3  shows  some 
examples  of  the  different  types  of  membership  functions  one 
might  encounter  in  this  experiment. 

In  order  to  link  the  results  from  this  experiment  to 


the  concept  of  membership  functions  one  must  posit  some 
fairly  strong  assumptions.  First,  it  must  be  assumed  that 
unique  membership  functions  exist  for  each  probability 
phrase  and  that  these  functions  are  generally  of  a 
monotonic  or  single-peaked  shape.  Secondly,  it  must  be 
assumed  that  these  membership  functions  have  a  maximum, 
which  may  occur  at  either  a  single  point  or  over  a  range  of 
values.  The  third  assumption,  which'ls  the  most  tenuous, 
is  that  in  judging  how  much  more  likely  one  spinner  rather 
than  the  other  is  to  land  on  white,  the  subject  focuses 
only  on  how  well  the  displayed  objective  probability  is 
described  by  the  phrase  associated  with  the  invisible 
spinner.  In  other  words,  the  response  depends  only  on  the 
value  of  that  objective  probability  in  that  phrase's 
membership  function.  Thus,  if  an  objective  probability 
with  the  value  1.0  in  a  phrase's  membership  function  were 
paired  with  that  phrase,  the  subject  would  consider  both 
the  visible  and  invisible  spinners  equally  likely  to  land 
on  white,  and  would  leave  the  arrow  in  the  middle  of  the 
response  line. 

Recall  that  the  response  line  is  scaled  0  (definite 
that  the  invisible  spinner  is  more  likely  to  land  on  white) 
to  200  (definite  that  the  visible  spinner  is  more  likely  to 
land  on  white).  Given  the  above  assumptions,  responses  can 
be  transformed  to  membership  function  values  by  the 
following  formula: 

m(p)  *  1  -  [(100  -  x)  /  100]  , 
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where  x  £  CO,  200]  is  the  response. 

There  are  other  assumptions  which  give  a  different 
interpretation  to  the  best  Judged  meaning  of  a  probability 
phrase.  For  example,  it  has  been  suggested  that  subjects 
may  think  of  the  low,  central,  and  high  probability  values 
for  a  given  phrase  and  then  perform  a  type  ef  weighted 
average  of  these  values  to  derive  their  best  Judged  meaning 
of  the  phrase  (Wallsten,  1986).  Depending  on  the  weights 
given  to  each  of  these  probability  values,  the  best  judged 
meaning  may  or  may  not  occur  at  the  peak  of  the  membership 
function  for  the  given  phrase.  This  will  be  discussed  in 
more  detail  below. 

Given  the  three  assumptions  initially  described  above, 
from  each  of  the  low,  middle,  and  high  probability  phrase 
pairs,  40  (20  subjects  by  2  phrases)  membership  functions 
can  be  generated.  Ignoring  the  desirability  factor 
temporarily,  and  using  mean  responses  averaged  over  all 
levels  of  desirability,  it  was  found  that  the  vast  majority 
(892)  of  the  derived  membership  functions  were  single- 
peaked.  These  results  are  shown  as  the  last  three  columns 
in  Table  7. 

Next,  the  responses  were  examined  at  each  level  of 
desirability  to  determine  if  the  desirability  factor  had  an 
effect  on  the  shape  of  subjects'  membership  functions. 

These  results,  displayed  in  the  first  nine  columns  of  Table 
7,  show  that  there  was  no  clear  effect  on  the  shape  of 
subjects'  membership  functions  due  to  desirability,  since 
the  total  number  of  monotonlc  membership  functions  under 
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each  level  of  desirability  was  about  the  sane  (12  C 10*3,  11 
(92],  and  16  (1321).  The  zero  desirability  condition  had 
the  fewest  nuaber  of  other-shaped  aeabershlp  functions,  Lut 
this  could  slaply  aean  that  the  desirability  factor 
Introduced  more  variability  In  subjects'  responses. 
Individual  subjects  did  have  differently  shaped  functions 
depending  on  desirability  level,  however,  which  accounts 
for  the  discrepancy  between  this  analysis  and  the  preceding 
one,  in  which  a  total  of  only  seven  monotonia  aeabershlp 
functions  were  found. 

One  finding  that  is  the  saae  in  both  analyses  and 
consistent  with  other  research  (Wallsten,  et  al,  in  press) 
is  that  aonotonic  functions  are  aore  prevalent  aaong  the 
lower  probability  phrases  than  aaong  the  higher  ones. 
However,  the  nuaber  of  aonotonic  membership  functions  found 
in  this  study  is  much  smaller  than  has  been  normally  found 
in  other  research  (Wallsten,  et  al,  in  press;  Rapoport, 
Wallsten,  4  Cox,  in  press).  This  may  indicate  that  nean 
responses  of  100  do  not  represent  the  peak  values  of  the 
membership  functions,  but  rather  the  weighted  average  of 
low,  central,  and  high  probability  values  relevant  to  a 
given  probability  phrase.  Under  this  interpretation,  it  is 
possible  that  many  of  the  membership  functions  labeled  as 
single-peaked  could  actually  be  aonotonic,  given  the 
appropriate  set  of  weights  used  in  the  averaging  process. 
These  weights  are  unknown  parameters,  however,  which  cannot 
be  determined  from  the  present  data. 


Based  on  the  assuaptlons  Initially  listed  above* 
desirability  seemed  to  have  no  effeot  on  the  shapes  of  the 
derived  membership  functions.  Thus*  it  is  hypothesized 
Instead  that  ZO  desirability  caused  a  shift  In  the  location 
of  the  membership  function  for  a  given  term.  When  the 
desirability  was  positive  for  the  spinner  and  negative  for 
the  probability  phrase,  the  membership  function  was  shifted 
to  the  left  of  where  It  was  when  there  was  no  desirability 
(toward  lower  probability  values).  When  the  desirability 
was  negative  for  the  spinner  and  positive  for  the 
probability  phrase,  the  membership  function  was  shifted  to 
the  right  of  where  it  was  when  there  was  no  desirability 
(toward  higher  probability  values).  Figure  4  shows  this 
shift  for  the  three  main  types  of  membership  functions  that 
were  encountered  in  this  experiment. 

Using  this  model*  one  can  explain  the  effect  of 
desirability  on  the  probability  terms,  doubtf u 1 .  good 
chance,  and  likely,  as  consisting  of  a  significant  shifting 
of  the  location  of  the  membership  functions  for  these 
terms.  For  the  tern,  improbabl e.  the  shift  was  not 
completely  made  for  the  case  of  positive  spinner 
desirability.  A  possible  reason  for  this  is  that  the 
membership  function  for  improbable  under  conditions  of  no 
desirability  may  be  located  near  the  bottom  of  the  range  of 
probability.  Thus,  there  may  not  have  been  enough  room  for 
a  significant  shift  to  the  left*  as  predicted  for  the 
positive  spinner/negative  phrase  desirability  effect.  The 
data  show  that  the  mean  responses  for  improbabl e  were 
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higher  than  those  for  the  other  low  probability  term, 
doubtful .  when  responses  were  averaged  over  all  factors, 
and  also  when  these  responses  were  averaged  over  each  level 
of  desirability.  These  results  imply  that  the  meaning  of 
improbable  was  the  lowest,  among  all  the  phrases  used  in 
this  study,  in  terms  of  subjective  probability.  This  gives 
some  credence  to  the  notion  that  the  membership  function 
for  ingrobable  may  be  so  close  to  the  bottom  of  the  range 
of  probability  values  that  it  precludes  a  significant  shift 
toward  lower  probabi lities.  However,  the  finding  that 
lnprobab 1 e  had  a  lower  judged  meaning  than  did  doubtful  is 
Inconsistent  with  previous  research  (Wallsten,  et  al,  in 
press) . 

Alternative  Explanation 

A  different  interpretation  of  the  results  of  this 
experiment  Involves  the  use  of  the  weighted  average  of  the 
low,  central,  and  high  probability  values  for  a  given 
phrase  (cf.  Wallsten,  1986).  The  pattern  of  results  for 
the  desirability  factor  can  be  explained  by  simply  assuming 
that  positive  splnner/negatlve  phrase  desirability  causes 
subjects  to  give  more  weight  to  the  low  probability  values, 
while  negative  splnner/poslti ve  phrase  desirability  causes 
subjects  to  give  more  weight  to  the  high  probability 
values.  In  other  words,  when  the  phrase  describes  a 
potential  loss,  subjects  concentrate  more  on  the  low 
probability  for  that  phrase,  and  when  it  describes  a 
potential  gain,  they  concentrate  more  on  the  high 
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probability  for  that  phrase.  The  different  desirability 
effects  for  low,  middle,  and  high  probability  phrases  can 
be  explained  by  assuming  that  the  weights  used  in  the 
averaging  process  for  the  middle  probability  terms  were  all 
about  equal,  while  for  the  low  probability  phrases  they 
were  slightly  different  from  each  other,  and  for  the  high 
probability  phrases  they  were  even  more  different  from  each 
other.  Of  course,  further  research  is  necessary  to 
Independently  test  these  assumptions. 

The  El  1 sberg  Paradox 

Tests  of  the  Ellsberg  paradox  showed  an  effect 
opposite  to  Ellsberg's  hypothesis  under  one  condition  of 
desirability.  The  one  significant  result  in  this  analysis 
(See  Table  5)  showed  that  when  desirability  favored  the 
phrase,  subjects  considered  the  ambiguous  "ncertainty  (the 
phrase,  tossup)  to  be  more  likely  than  the  precise  one  (the 
objective  probability  of  0.50).  This  is  consistent  with 
the  hypothesis  that  subjects'  responses  will  be  biased 
towards  the  outcome  with  the  relatively  favorable 
desirability. 

Further,  it  is  of  interest  that  the  results  predicted 
from  the  Ellsberg  paradox  did  not  occur  in  any  case.  That 
is,  subjects  never  accorded  a  significantly  higher 
subjective  value  to  the  objective  probability  of  0.50  than 
to  the  phrases,  tossup  and  unspeci f i ed.  Possibly,  Ellsberg 
was  dealing  with  betting  preferences,  while  the  present 
study  deals  with  judgments  of  relative  likelihood.  Thus, 


the  Ellsberg  paradox  may  actually  represent  a  type  of 
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ambiguity  aversion  In  a  gambling  scenario 


If  the  term,  unspecified,  truly  represented  a 
condition  of  ignorance,  then  desirability  did  not  exert  a 
strong  enough  effect  to  cause  subjects  to  consider  the 
condition  of  Ignorance  as  more  likely  than  the  condition  of 
risk.  Given  the  previous  discussion  of  the  fairly  precise 
meaning  of  unspecified,  however,  it  may  be  that  this  term 
represented  ambiguity  rather  than  ignorance. 

D1 f Terences  from  Previous  Research 

There  are  some  Important  differences  between  these 
results  and  those  found  by  earlier  studies.  First,  it  was 
previously  found  that  the  effect  of  10  was  strongest  for 
objective  probabl llties  of  0.50  (Irwin  &  Snodgrass,  1966; 
Mor lock  &  Hertz,  1964;  Crandall,  Solomon,  &  Kellaway, 

1955).  It  was  therefore  hypothesized  that  the  strongest 
effect  of  10  desirability  in  the  present  study  would  be 
found  in  the  case  where  the  probability  0.50  was  paired 
with  the  phrase,  tossup.  This  turned  out  to  be  one  of  the 
weakest  effects  in  the  experiment,  although  it  was  In  the 
appropriate  direction.  Another  Interesting  difference  was 
that  the  high  terms  seemed  to  show  stronger  effects  of 
desirability  than  did  the  low  terms.  This  result  did  not 
occur  in  the  earlier  research  under  conditions  of  risk. 

Both  of  these  differences  may  be  the  result  of  this 
experiment's  requiring  a  Judgment  of  relative  likelihood 
between  a  verbal  expression  of  ambiguity  and  an  objectively 
stated  probability,  whereas,  the  earlier  studies  dealt 
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solely  with  objective  probabilities.  One  finding  fron  the 
earlier  research  on  Independent  outcoae  desirability  that 
was  replicated  was  that  the  desirability  effect  was 
maintained  even  though  the  independent  outcomes  were 
probabilistic  (cf.  Irwin  4  Metzger,  1966). 

It  turned  out  that  the  nature  of  the  present  task  was 
problematic.  Subjects  were  asked  to  concentrate  on  making 
their  best  Judgment  as  to  the  relative  likelihoods  of  the 
two  paired  events  on  each  trial.  They  were  told  that  the 
points  were  put  on  the  screen  to  help  them  pay  attention  to 
the  task  and  to  make  it  more  interesting.  Despite  the 
written  instructions,  which  Indicated  that  all  outcomes 
were  based  solely  on  fixed,  pr edetermlned  probability 
values,  some  subjects  mentioned  after  the  experiment  that 
they  tried  to  figure  out  what  "system"  governed  the 
awarding  of  points.  The  questionnaire  given  to  subjects  at 
the  end  of  the  experiment  was  an  attempt  to  determine  how 
deeply  this  tendency  affected  subjects*  responses.  As 
pointed  out  above,  however,  the  questionnaire  did  not  seem 
to  provide  any  valid  information  on  this  issue. 

Summary  and  Conclusions 

This  experiment  showed  that  Independent  outcome 
desirability  is  one  context  factor  that  appears  to  affect 
the  vague  meanings  of  probability  phrases.  Judgments  of 
relative  likelihood  were  found  to  be  biased  somewhat  toward 
the  outcome  with  the  relatively  favorable  deslrabl 1 1 ty. 
Given  certain  assumptions,  independent  outcome  desirability 
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effects  can  be  Interpreted  as  causing  shifts  In  the 
location  of  the  membership  functions  for  probability 
phrases,  without  changing  the  shape  of  the  membership 
functions.  A  different  explanation  could  Involve  the  way 
In  which  desirability  affects  the  weighted  averaging 
process  used  to  derive  the  best  judged  meaning  for  a 
probability  phrase. 

The  most  plausible  explanation  of  the  10  desirability 
effects  would  need  to  Involve  all  the  factors  relevant  to  a 
judgment  of  relative  likelihood  between  a  probability 
phrase  and  an  objective  probability.  Three  of  these 
factors,  discussed  above,  are:  (a)  the  subjective  value 
that  Is  accorded  to  the  objectively  stated  probability,  (b) 
the  judged  meaning  of  the  probability  phrase,  and  (c> 
ambiguity  aversion.  It  would  be  desirable  to  study  each  of 
these  factors  In  Isolation  within  the  context  of  examining 
the  meanings  of  probability  phrases. 
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Table  2 


Desirability  Effects  in  Terms  of  Mean  Response  Values 
for  Each  Phrase  and  Combined  over  Similar  Phrases 


Spinner  * 

-500 

0 

♦5  00 

Phrase  a 

+500 

0 

-500 

Doubtfu  1 

108.47 

112.09 

118.11 

Good  Chance 

97.77 

110.68 

115.56 

Improbabl e 

111.21 

120.24 

118.51 

Likely 

94.99 

112.93 

115.98 

To»sup 

96.34 

101.39 

103.44 

Unspecified 

102.68 

103.32 

107.36 

Doubtful  & 
Improbable 

109.84 

116.16 

118.31 

Good  Chance 
&  Likely 

96.38 

1 11.80 

115.77 

Tossup  & 

99.51 

102.36 

105.40 

Unspeci f 1 ed 
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Table  3 

F-Ratlos  from  ANOVAs  on  Individual  Probability  Phrases 


Phrase 

Sessions 

Probabi lltyb 

Desirabl lit yo 

Doubtf u 1 

0.86 

63.51 

ee 

5.02 

e 

Good  Chance 

0.00 

73.13 

M 

• 

5.67 

ee 

Improbable 

0.62 

51.37 

ee 

5.53 

ee 

Likely 

1.14 

61.28 

ee 

22.90 

ee 

Tossup 

0.01 

76.60 

ee 

1.38 

Unspecified 

1.08 

36.11 

ee 

0.47 

a)  df  s  (1,19) 

b)  df  s  (3,57)  for  Doubtful,  Good  Chance,  Improbable,  and 

Likely 

df  s  (2,33)  for  Tossup  and  Unspecified 

c)  df  s  (2,38) 

•  £  <  0.05.  ••  £  <  0.01. 
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F-Ratios  from  ANOVAS  on  Combined  Probability  Phrases 


Phrase  Phrasea  Probabi 1 ityb  Desirabi lity0  Probability4  * 


Pair 

\ 

Desirabi lity 

Doubtful  A  3*39 

Improbable 

66.94 

ee 

6.81  •• 

0.78 

Good  Chance  0.00 

A  Likely 

78.46 

•  e 

13.71  •• 

1.89 

Tossup  A  3.84 

Unspecified 

65.69 

•  a 

1.24 

2.08 

a)  df  s  (1,19) 

b)  df  s  (3,57)  for  Doubtful  A  Improbable,  Good  Chance  & 

Likely 

df  s  (2,38)  for  Tossup  A  Unspecified 

c)  df  *  (2,38) 

d)  df  s  (6,114)  for  Doubtful  A  Improbable,  Good  Chance  A 

Likely 

df  a  (4,76)  for  Tossup  A  Unspecified 
•  £  <  0.05.  ••  £  <  0.01. 
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Table  5 

Tests  of  Whether  Mean  Responses  are  Significantly 
Below  100  for  the  Neutral  Phrases  vs.  0*50 


Spinner  s 

-500 

0 

♦  500 

Phrase  * 

♦  500 

0 

-500 

Tossup 

Mean  Response 

94.06 

97.58 

103.93 

T-Value 

-2.01  * 

-0.79 

1.26 

Unspecified 

Mean  Response 

98.00 

99.61 

105.06 

T- Value 

-0.48 

-0.1 1 

1.37 

Table  6 


F-Ratlos  from  ANOVAs  for  Subjects  who 
Understood/Did  not  Understand  the  Instructions 


Phrase  ! 

Pair 

Phrase  Probability 

Deslrabl llty 

Probability  x 
Deslrabl llty 

Subjects  who 

Understood 

the  Instructions 

Doubtful  & 

0.79 

*7.62  •• 

*3.25 

1.23 

Improbable 

<df)* 

(1,10) 

(3,30) 

(2.20) 

(6,60) 

Good  Chance 

0.81 

153.03  •• 

7.41  •• 

1.40 

A  Likely 

(d  f )  a 

(1,10) 

(3,30) 

(2,20) 

(6,60) 

Tossup  & 

5.86  • 

49.60  •* 

2.48 

0.31 

Unspecified 

(d  f  )  s 

(1,10) 

(2,20) 

(2,20) 

(4,40) 

Subjects 

who  did 

Not  Understand 

the  Instructions 

Doubtful  A 

4.75 

24.34  •* 

4.21  • 

0.52 

Improbable 

(df)s 

(1,8) 

(3,24) 

(2,16) 

(6,48) 

Good  Chance 

2.51 

14.67  •• 

5.95  • 

1.14 

A  Likely 

(df  )3 

(1,8) 

(3,24) 

(2,16) 

(6,48) 

Tossup  A 

0.02 

19.50  •* 

2.29 

0.93 

Unspecified 

(d  f )  = 

(1,8) 

(2,16) 

(2,16) 

(4,32) 

•  £  <  0.05.  ••  £  <  0.0 1. 
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)  Table  7 

Monotonic  (H),  Single-Peaked  (SP),  and  Other  (0) 
Membership  Functions  for  Each  Phrase  and  Desirability  Level, 
and  Averaged  over  All  Desirability  Levels 


Spinner  * 
Phrase  s 

-500 

t-500 

0 

0 

4-500 

-500 

Overal  1 

M 

SP 

0 

M 

SP 

0  • 

M 

SP 

O 

M 

SP 

0 

Lou  phrases 

Doubtf u 1 

3 

14 

3 

2 

1  4 

4 

1 

13 

6 

2 

17 

1 

Improbable 

3 

1  1 

6 

5 

12 

3 

6 

12 

2 

3 

16 

1 

Sub-Total 

6 

25 

9 

7 

26 

7 

7 

25 

8 

5 

33 

2 

Middle  phrases 

Tossup 

2 

15 

3 

1 

17 

2 

2 

15 

3 

0 

20 

0 

Unspecl fled 

2 

14 

4 

2 

17 

1 

6 

14 

0 

2 

18 

0 

Sub-Total 

4 

29 

7 

3 

3* 

3 

8 

29 

3 

2 

38 

0 

High 

phrases 

Good  Chance 

2 

16 

2 

1 

18 

1 

0 

14 

6 

0 

18 

2 

Likely 

0 

16 

4 

0 

18 

2 

1 

17 

2 

0 

18 

2 

Sub-Total 

2 

32 

6 

1 

36 

3 

1 

31 

8 

0 

36 

4 

Tot  als 

12 

86 

22 

1 1 

96 

13 

16 

85 

19 

7 

107 

6 

Figure  1 
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Graph  of  M«an  Responses  as  a  Function  of  Probability  for 
Individual  Phrases,  Ignoring  Desirability 


Hean 

Response 


180  ♦ 

I 

I 


170  ♦ 


I 

30  ♦ 

so  i 

I 

10  ♦ 

I 

0  ♦ 

0  0.1  0.2  0.3  0.4  0.5  0.6  0.7  0.8  0.9  1.0 

Probability 

D  *  doubtful  T  s  tossup  G  s  good  chance 

I  3  Improbable  U  s  unspecified  L  s  likely 


Figure  2 


Graph  of  Mean  Responses  as  a  Function  of  Probability  for 
Phrase  Pairs,  Ignoring  Desirability 

Mean 

Response 

170  ♦ 

• 

160  ♦ 

I 

150  ♦ 

I 
I 

140  ♦ 

» 

130  ♦ 

f 

120  ♦ 

I 

110  ♦ 

100  ♦ 

90  ♦ 

• 

80  ♦ 

70  ♦ 

I 
I 

60  ♦ 

50  ♦ 

I 

40  ♦ 

30  ♦ 

20  ♦ 

10  ♦ 
t 
I 

0  ♦ 

0  0.1  0.2  0.3  0.4  0.5  0.6  0.7  0.8  0.9  1.C 

Probabi 1 lty 

L  s  Lou  probability  phrases  (doubtful  &  Improbable) 

M  *  Middle  probability  phrases  (tossup  &  unspecified) 
H  «  High  probability  phrases  (likely  &  good  chance) 


Figure  3 


Types  of  Membership  Functions 


Monotonio  decreasing 


Spinner  probability 


2.  Monotonio  increasing 


0 

Spinner  probability 


3.  Single-peaked 


Spinner  probability 


Figure  <1 


Hypothesized  Effect  of  Independent  Outcome  Desirability 

on  Membership  Functions 

1.  Monotonic  decreasing 


0  1 
Spinner  probability 


2.  Monotonlc  Increasing 


0  1 
Spinner  probability 


3.  Single-peaked 


0  1 
Spinner  probability 
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Appendix 

WHITE:  -500 

RED:  0 

WINNINGS: 

1000 

WHITE:  500 
RED:  0 

•  •  • 

.  S 

1 

•  9  • 

•  R 

1 

•  1  ““““  e 

tf 

•  • 

•  • 

e  •  • 

LIKELY 
to  land  on 
white. 

------------ 

• 

\/ 

In  the  screen  drawn  above,  the  visible  spinner  is  on 
the  left  and  the  word,  Likely,  is  on  the  right.  Inside  the 
spinner,  the  letters  V  and  R  stand  for  the  colors  white  and 
red,  respectively.  Suppose  that  you  viewed  this  screen 
during  the  experiment  and  you  positioned  the  arrow 
approximately  where  it  is  in  the  drawing  above. 

Given  that  you  have  the  arrow  positioned  on  the  right 
side  of  the  line  segment,  what  effect  does  this  have  on  the 
likelihood  of  the  visible  spinner's  landing  on  white? 

A)  It  increases  the  likelihood  of  the  visible  spinner's 
landing  on  white. 

B)  It  decreases  the  likelihood  of  the  visible  spinner's 
landing  on  white. 

C)  It  has  no  effect  on  the  likelihood  of  the  visible 
spinner's  landing  on  white. 


2) 


WINNINGS: 


WHITE*  -500  1000  WHITE:  500 

RED:  0  RED:  0 

•  •  • 

.  I 

.  I 

)  R  LIKELY 

,  S - — — .  to  land  on 

W  white. 


In  the  screen  drawn  above*  the  visible  spinner  is  on 
the  left  and  the  word,  Likely,  Is  on  the  right.  Inside  the 
spinner,  the  letters  W  and  R  stand  for  the  colors  white  and 
red,  respectively.  Suppose  that  you  viewed  this  screen 
during  the  experiment  and  you  positioned  the  arrow 
approximately  where  It  Is  in  the  drawing  above. 

Now,  it  turned  out  that  both  the  visible  spinner  and 
the  Invisible  spinner  landed  on  white.  In  this  case, 
describe  what  happens  to  your  cumulative  total  of  points: 


A) 

It 

Increases 

by 

500  points. 

B) 

It 

decreases 

by 

500  points. 

C) 

It 

Increases 

by 

1000  points. 

D) 

It 

decreases 

by 

1000  points. 

E) 

Nothing  happens 

to  your  cumulative  total  of  points 

6 

3)  a)  In  general,  did  you  think  that  where  you  placed  the  | 

arrow  Influenced  the  outcone  of  the  spinners? 

b)  Old  you  think  that  your  placement  of  the  arrow  had 
an  effect  on  the  amount  of  points  that  you  could  win  or 
lose  on  a  given  trial? 

o)  What  guided  your  placement  of  the  arrow  when  you 
were  presented  the  word,  "unspecified?" 


) 


r 


